Files
cypress/system-tests/__snapshots__/screenshots_spec.js
Bill Glesias 9580dc2e35 breaking: default video configuration option to false (#27008)
* chore: update darwin v8 snapshot

* BREAKING CHANGE: set video to false by default (system tests need updating).

* Update cli/CHANGELOG.md

Co-authored-by: Emily Rohrbough <emilyrohrbough@users.noreply.github.com>

* chore: update type comments

* chore: update protocol snapshot

* run ci

* run ci

* set video to true for chrome browser crash test

* chore: put in workaround for failing system test spec to be fixed in 27062

* chore: allow retries on actionability tests to be at least one retry as the CI tests run faster without video on

* chore: fix flaky navigation test where done is called multiple times almsot always, but sometimes throws an error

---------

Co-authored-by: Emily Rohrbough <emilyrohrbough@users.noreply.github.com>
2023-06-20 13:21:39 -04:00

186 lines
12 KiB
JavaScript

exports['e2e screenshots / passes'] = `
====================================================================================================
(Run Starting)
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Cypress: 1.2.3 │
│ Browser: FooBrowser 88 │
│ Specs: 1 found (screenshots.cy.js) │
│ Searched: cypress/e2e/screenshots.cy.js │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
────────────────────────────────────────────────────────────────────────────────────────────────────
Running: screenshots.cy.js (1 of 1)
taking screenshots
✓ manually generates pngs
✓ can nest screenshots in folders
1) generates pngs on failure
✓ calls onAfterScreenshot with results of failed tests
✓ handles devicePixelRatio correctly on headless electron
✓ crops app captures to just app size
✓ can capture fullPage screenshots
✓ accepts subsequent same captures after multiple tries
✓ accepts screenshot after multiple tries if somehow app has pixels that match helper pixels
✓ can capture element screenshots
✓ retries each screenshot for up to XX:XX
(Attempt 1 of 3) screenshots in a retried test
(Attempt 2 of 3) screenshots in a retried test
2) screenshots in a retried test
✓ ensures unique paths for non-named screenshots
3) ensures unique paths when there's a non-named screenshot and a failure
✓ properly resizes the AUT iframe
- does not take a screenshot for a pending test
✓ adds padding to element screenshot when specified
✓ does not add padding to non-element screenshot
✓ can pass overwrite option to replace existing filename
✓ can set overwrite default option to replace existing filename
clipping
✓ can clip app screenshots
✓ can clip runner screenshots
✓ can clip fullPage screenshots
✓ can clip element screenshots
before hooks
4) "before all" hook for "empty test 1"
each hooks
5) "before each" hook for "empty test 2"
6) "after each" hook for "empty test 2"
really long test title aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
✓ takes a screenshot
✓ takes another screenshot
22 passing
1 pending
6 failing
1) taking screenshots
generates pngs on failure:
Error: fail whale
[stack trace lines]
2) taking screenshots
screenshots in a retried test:
Error: fail
[stack trace lines]
3) taking screenshots
ensures unique paths when there's a non-named screenshot and a failure:
Error: failing on purpose
[stack trace lines]
4) taking screenshots
before hooks
"before all" hook for "empty test 1":
Error: before hook failing
Because this error occurred during a \`before all\` hook we are skipping the remaining tests in the current suite: \`before hooks\`
[stack trace lines]
5) taking screenshots
each hooks
"before each" hook for "empty test 2":
Error: before each hook failed
Because this error occurred during a \`before each\` hook we are skipping the remaining tests in the current suite: \`each hooks\`
[stack trace lines]
6) taking screenshots
each hooks
"after each" hook for "empty test 2":
Error: after each hook failed
Because this error occurred during a \`after each\` hook we are skipping the remaining tests in the current suite: \`each hooks\`
[stack trace lines]
(Results)
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Tests: 28 │
│ Passing: 22 │
│ Failing: 5 │
│ Pending: 1 │
│ Skipped: 0 │
│ Screenshots: 34 │
│ Video: false │
│ Duration: X seconds │
│ Spec Ran: screenshots.cy.js │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
(Screenshots)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/black.png (1280x720)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/red.png (1280x720)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/foo/bar/baz.png (1280x720)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- generat (1280x720)
es pngs on failure (failed).png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/color-check.png (1280x720)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/crop-check.png (600x400)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/fullPage.png (600x500)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/fullPage-same.png (600x500)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/pathological.png (1280x720)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/element.png (400x300)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- retries (200x1300)
each screenshot for up to XX:XX.png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/retrying-test.png (1000x660)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- screens (1280x720)
hots in a retried test (failed).png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/retrying-test (attempt 2).png (1000x660)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- screens (1280x720)
hots in a retried test (failed) (attempt 2).png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/retrying-test (attempt 3).png (1000x660)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- screens (1280x720)
hots in a retried test (failed) (attempt 3).png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- ensures (1280x720)
unique paths for non-named screenshots.png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- ensures (1280x720)
unique paths for non-named screenshots (1).png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- ensures (1280x720)
unique paths for non-named screenshots (2).png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- ensures (1000x660)
unique paths when there's a non-named screenshot and a failure.png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- ensures (1280x720)
unique paths when there's a non-named screenshot and a failure (failed).png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/aut-resize.png (1000x2000)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/element-padding.png (420x320)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/non-element-padding.png (600x200)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/overwrite-test.png (100x50)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/app-clip.png (100x50)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/runner-clip.png (120x60)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/fullPage-clip.png (140x70)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/element-clip.png (160x80)
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- before (1280x720)
hooks -- empty test 1 -- before all hook (failed).png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- each ho (1280x720)
oks -- empty test 2 -- before each hook (failed).png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- each ho (1280x720)
oks -- empty test 2 -- after each hook (failed).png
- /XXX/XXX/XXX/cypress/screenshots/screenshots.cy.js/taking screenshots -- really (1000x660)
long test title aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.png
====================================================================================================
(Run Finished)
Spec Tests Passing Failing Pending Skipped
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ ✖ screenshots.cy.js XX:XX 28 22 5 1 - │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
✖ 1 of 1 failed (100%) XX:XX 28 22 5 1 -
`