Commit Graph

20168 Commits

Author SHA1 Message Date
Matt Schile a22fd5cb82 dependency: updated chrome-remote-interface to 0.33.0 (#27998)
* dependency: updated chrome-remote-interface to 0.33.0

* updating changelog

* updating tests

* updating snapshot

* enable debug logs

* run ci without app integration tests

* .

* is this our problem? seems to be

* .

* run app tests

* .

* remove debug logs in ci

* clean up & re-enable all jobs

* .

* keep existing checked in error for now

* update changelog

---------

Co-authored-by: Emily Rohrbough <emilyrohrbough@yahoo.com>
Co-authored-by: Emily Rohrbough <emilyrohrbough@users.noreply.github.com>
2023-11-20 16:08:52 -05:00
Matt Schile d964865357 fix: update getPath to use WHATWG URL API (#28354) 2023-11-20 12:46:04 -07:00
Simon Törnqvist 2041c696e9 fix(driver): dynamic intercept aliases shown with name instead of no alias (#28326)
Co-authored-by: jordanpowell88 <jordan@jpdesigning.com>
2023-11-20 13:50:11 -05:00
renovate[bot] 2eb84558ed chore(deps): update dependency crypto-js to v4.2.0 [security] (#28146)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: Emily Rohrbough <emilyrohrbough@users.noreply.github.com>
Co-authored-by: Jennifer Shehane <jennifer@cypress.io>
2023-11-20 12:14:13 -05:00
Cacie Prins e3ba69781d feat: display an activity indicator in the CLI output when uploading artifacts to cypress cloud (#28277)
* logic for activity indicator

* update snapshot & masking to handle upload duration, remove defunct mask for upload order

* update changelog

* check for existence of upload activity indicator before attempting to stop it

* updates changelog

* Update cli/CHANGELOG.md

* upload activity display improvements; configurable intervals and delays

* system test snapshots for video compression

* default delay and interval based on undefined rather than falsy

* reduce interval so upload indicator is captured in certain system tests

* Update CHANGELOG.md

* Update CHANGELOG.md

* remove initial delay for upload activity

* correctly evaluate if an upload activity interval env is set or not

* re-inserts spacing before upload activity indicator

* snapshots

---------

Co-authored-by: Jennifer Shehane <jennifer@cypress.io>
2023-11-20 11:50:53 -05:00
Jordan 02d0493472 fix(driver): add support for alias.all when using dynamic alias (#28352)
* add tests for failing instance

* fix: support for dynamic alias.all

* update changelog

* Update cli/CHANGELOG.md

Co-authored-by: Matt Schile <mschile@cypress.io>

* move test

* Update cli/CHANGELOG.md

Co-authored-by: Emily Rohrbough <emilyrohrbough@users.noreply.github.com>

---------

Co-authored-by: Matt Schile <mschile@cypress.io>
Co-authored-by: Emily Rohrbough <emilyrohrbough@users.noreply.github.com>
2023-11-16 16:17:11 -05:00
Chris Breiding d6e2a0d992 fix: Open app urls externally instead of in Cypress-launched browser (#28351)
Co-authored-by: Matt Schile <mschile@cypress.io>
2023-11-16 14:47:19 -05:00
Chris Breiding 06b5ca280c misc: Ensure cypress tab is active before any command runs (#28334) 2023-11-16 13:09:35 -05:00
Chris Breiding 424d408e26 misc: Close extra tabs/windows between tests (#28204) 2023-11-16 11:39:06 -05:00
Cacie Prins d54a1e9a57 feat: display artifact upload durations in the console (#28226)
* feat: display how long artifacts take to upload

* adds changelog entry

* add PR link to changelog

* bump circle cache

* previous masking was too greedy, made upload duration masking more limited in scope

* update snapshots for video compression system tests

* links changelog for upload durations to open issue

* reorder upload result manifest - show duration after filesize instead of after count

* update stdout normalization regex to be less applicable across system tests

* maybe better regex for masking

* another snapshot attempt

* chore: add after:browser:launch node event (#28180)

* test: update mochaEvent snapshots to be auto-generated (#28224)

* feat: add support for angular 17 (#28152)

* feat(webpack-dev-server): add support for angular 17

* update changelog

* fix broken spec pattern

* update to rc 2 for cli

* remove = from dependency minVersion lists

* update angular 17 rc version and update dep test

* add projectDirFolder to fixtures for angular-17

* resolve broken system tests

* update ct project dir angular version

* fix: runIfWaitingForDebugger when targets are reloaded after crashing (#28254)

* Update cli/CHANGELOG.md

Co-authored-by: Matt Schile <mschile@cypress.io>

* update snapshots

* Update CHANGELOG.md

---------

Co-authored-by: Chris Breiding <chrisbreiding@users.noreply.github.com>
Co-authored-by: Matt Schile <mschile@cypress.io>
Co-authored-by: Jordan <jordan@jpdesigning.com>
Co-authored-by: Ryan Manuel <ryanm@cypress.io>
2023-11-16 10:01:54 -05:00
Jordan ab60af8633 chore: release 13.5.1 (#28333) v13.5.1 2023-11-14 12:02:55 -06:00
Ryan Manuel 16d6430827 fix: performance regression due to enabling ScopeMemoryCachePerContext (#28327) 2023-11-14 11:10:34 -06:00
Miles Sitcawich e308603c3a docs: correct typo in CONTRIBUTING (#27343)
Co-authored-by: Jennifer Shehane <jennifer@cypress.io>
2023-11-14 11:46:42 -05:00
Chris Breiding 9d9bf25977 fix: Ensure response headers are set for extra target network requests (#28322) 2023-11-13 17:51:51 -05:00
Jennifer Shehane 8274f5ddb2 fix: Add Chromium flag to disable-component-extensions-with-background-pages (#28294) 2023-11-13 11:36:23 -05:00
Jordan a23dba19af chore: release 13.5.0 (#28278) v13.5.0 2023-11-08 13:36:09 -05:00
Matt Schile 7392f615fe test: updating path separator for mochaEvents (#28265) 2023-11-07 13:31:23 -06:00
semantic-release-bot 79da763dfa chore: release @cypress/webpack-dev-server-v3.7.0
[skip ci]
@cypress/webpack-dev-server-v3.7.0
2023-11-07 11:33:28 -05:00
Emily Rohrbough 176280dd49 chore: release 13.5.0 - update changelog (#28262) 2023-11-07 09:58:57 -06:00
Ryan Manuel d70ffea0bf fix: runIfWaitingForDebugger when targets are reloaded after crashing (#28254) 2023-11-07 07:37:12 -06:00
Jordan e8fc268953 feat: add support for angular 17 (#28152)
* feat(webpack-dev-server): add support for angular 17

* update changelog

* fix broken spec pattern

* update to rc 2 for cli

* remove = from dependency minVersion lists

* update angular 17 rc version and update dep test

* add projectDirFolder to fixtures for angular-17

* resolve broken system tests

* update ct project dir angular version
2023-11-07 07:35:26 -05:00
Matt Schile 9f19f9a513 test: update mochaEvent snapshots to be auto-generated (#28224) 2023-11-06 16:54:21 -07:00
Chris Breiding 934f2157b3 chore: add after:browser:launch node event (#28180) 2023-11-06 17:32:39 -05:00
Emily Rohrbough eab1730dbb fix: handle download from element missing download attribute (#28222) 2023-11-06 14:06:59 -06:00
Jennifer Shehane db8609e54f fix: Pass flag to chrome to disable translation prompt when running tests (#28227) 2023-11-06 11:56:11 -06:00
Ryan Manuel 5dbebe6e5e fix: ensure that chromium based browsers do not send out a lot of font requests when global styles change (#28217) 2023-11-03 14:39:56 -05:00
Ryan Manuel 8c4a1067cb fix: issue with 'other' targets not fully loading (#28229) 2023-11-03 11:28:49 -05:00
Emily Rohrbough 6620eb3087 chore: use shallow checkout (expect for windows) (#28230) 2023-11-03 09:10:27 -05:00
Matt Schile 969d28c59c fix: pass undefined to test:before:after:run:async if there isn't a next test (#28213) 2023-11-02 14:23:25 -06:00
Chris Breiding a0cfed5044 fix: "bypass" proxying network requests from extra browser tabs/windows (#28188)
Co-authored-by: Ryan Manuel <ryanm@cypress.io>
Co-authored-by: Matt Schile <mschile@cypress.io>
2023-11-02 13:55:13 -04:00
Tanmay Mohapatra becb893f07 docs: Fix config option example typo in tooltip (#28174)
Co-authored-by: Emily Rohrbough <emilyrohrbough@users.noreply.github.com>
2023-11-01 11:14:40 -04:00
Carolina Urrea 3967b4801a fix: update visibility check with overflow: hidden and element on the edge (#27586)
Co-authored-by: Chris Breiding <chrisbreiding@users.noreply.github.com>
Co-authored-by: Matt Schile <mschile@cypress.io>
Co-authored-by: Jennifer Shehane <jennifer@cypress.io>
Co-authored-by: Emily Rohrbough <emilyrohrbough@yahoo.com>
Co-authored-by: Emily Rohrbough <emilyrohrbough@users.noreply.github.com>
2023-10-31 13:39:29 -05:00
Chris Breiding 6aafb528dd chore: extract Target.attachedToTarget and Target.targetDestroyed handlers into own methods (#28179) 2023-10-31 10:48:45 -04:00
Cacie Prins 5a95541c3c chore: sets date for 13.4.0 release in changelog to 10/30 (#28177) v13.4.0 2023-10-30 08:42:14 -05:00
Cacie Prins 08d73d4a53 chore: fixes changelog whitespace (#28168) 2023-10-27 12:27:34 -05:00
Cacie Prins 397ab4c820 chore: 13.4.0 release updates (#28166) 2023-10-27 11:32:43 -05:00
Cacie Prins e0ad2d7336 chore: fixes changelog whitespace (#28164) 2023-10-27 10:53:38 -05:00
Cacie Prins 7defccfe45 chore: increase timeout for experimental retries test (#28163) 2023-10-27 10:35:00 -05:00
Ryan Manuel 4036d713a3 chore: update changelog for #28141 fix (#28161)
Co-authored-by: Matt Schile <mschile@cypress.io>
2023-10-27 10:14:54 -05:00
cypress-bot[bot] f30a16a40c chore: updating v8 snapshot cache 2023-10-26 21:35:07 +00:00
cypress-bot[bot] 95d1a0c671 chore: updating v8 snapshot cache 2023-10-26 21:15:28 +00:00
Cacie Prins b4cfb47122 chore: update @ffprobe-installer/ffprobe so all system tests run on darwin-arm64 (#27802) 2023-10-26 15:10:07 -04:00
Bill Glesias 201e9f366e feat: experimental retries (#27930)
* chore: set up feature/test-burn-in feature branch

* feat: add burnIn Configuration option (currently a no-op) (#27377)

* feat: add the burnIn Configuration to the config package. Option
currently is a no-op

* chore: make burn in experimental

* chore: set experimentalBurnIn to false by default

* feat: add new experimental retries configuration (#27412)

* feat: implement the experimental retries configuration options to pair
with test burn in

* [run ci]

* fix cache invalidation [run ci]

* fix snapshot added in v13 for module api to include test burn in experimentalflag

* chore: fix merge conflict

* chore: add burnInTestAction capability (#27768)

* add burnInTestAction capability

* feat: add burn in capability for cloud

* chore: fix snapshot for record_spec

* feat: implement experimental retries (#27826)

* chore: format the retries/runner snapshot files to make diff easier

* feat: implement experimentalRetries strategies 'detect-flake-and-pass-on-threshold' and 'detect-flake-but-always-fail'. This should not be a breaking change, though it does modify mocha and the test object even when the experiment is not configured. This is to exercise the system and make sure things still work as expected even when we go GA. Test updates will follow in following commits.

* chore: update snapshots from system tests and cy-in-cy tests that now have the cypress test metadata property _cypressTestStatusInfo. tests have been added in the fail-with-[before|after]each specs to visually see the suite being skipped when developing.

* chore: add cy-in-cy tests to verify reporter behavior for pass/fail tests, as well as new mocha snapshots to verify attempts. New tests were needed for this as the 'retries' option in testConfigOverrides currently is and will be invalid for experiment and will function as an override. tests run in the cy-in-cy tests are using globally configured experimentalRetries for the given tested project, which showcases the different behavior between attempts/retries and pass/fail status.

* chore: add unit test like driver test to verify the test object in mocha is decorated/handled properly in calculateTestStatus

* chore: add sanity system tests to verify console reporter output for experimental retries logic. Currently there is a bug in the reporter where the logged status doesnt wait for the aftereach to complete, which impacts the total exitCode and printed status.

* fix: aftereach console output. make sure to fail the test in the appropriate spot in runner.ts and not prematurely, which in turn updates the snapshots for cy-in-cy as the fail event comes later."

* chore: address comments from code review

* fix: make sure hook failures print outer status + attempts when the error is the hook itself.

* chore: improve types within calculateTestStatus inside mocha.ts

* Revert "feat: add burnIn Configuration option (currently a no-op) (#27377)"

This reverts commit c428443079.

* Revert "chore: add burnInTestAction capability (#27768)"

This reverts commit ae3df1a505.

* chore: run snapshot and binary jobs against experimental retries feature branch

* chore: add changelog entry (wip)

* Revert "fix snapshot added in v13 for module api to include test burn in experimentalflag"

This reverts commit bb5046c91e.

* Fix system tests

* Clear CircleCI cache

* Normalize retries config for test execution

* Fixed some unit tests

* update snapshots for newer test metadata

* Fix cy-in-cy snapshots

* update snapshots

* bump cache version

* chore: ensure legacy retry overrides work; reject exp. retries overrides (#28045)

* update changelog

* flip if statement in experimental retries option validation

* refactor invalid experimental retry override for more useful error msg

* revert testConfigOverrides snapshot

* update snapshots for test override sys test

* Update packages/config/src/validation.ts

Co-authored-by: Chris Breiding <chrisbreiding@users.noreply.github.com>

* succinct changelog entry; links to docs for details

* testConfigOverride system test snapshots

* Update .github/workflows/update_v8_snapshot_cache.yml

Co-authored-by: Ryan Manuel <ryanm@cypress.io>

* Update cli/CHANGELOG.md

Co-authored-by: Ryan Manuel <ryanm@cypress.io>

* Update packages/driver/src/cypress.ts

Co-authored-by: Ryan Manuel <ryanm@cypress.io>

* updating cache-version

* improve typescript usage when appending experimental retry options to experiments in Experimenets.vue

* Revert "improve typescript usage when appending experimental retry options to experiments in Experimenets.vue"

This reverts commit b459aba882.

* refactor test config override validation for experimental retry subkeys

* account for error throw differences in browsers in system tests

* bump circle cache

* bump circle cache again

---------

Co-authored-by: astone123 <adams@cypress.io>
Co-authored-by: mabela416 <mabel@cypress.io>
Co-authored-by: Muaz Othman <muaz@cypress.io>
Co-authored-by: Muaz Othman <muazweb@gmail.com>
Co-authored-by: Cacie Prins <cacie@cypress.io>
Co-authored-by: Cacie Prins <cacieprins@users.noreply.github.com>
Co-authored-by: Chris Breiding <chrisbreiding@users.noreply.github.com>
Co-authored-by: Ryan Manuel <ryanm@cypress.io>
Co-authored-by: Matthew Schile <mschile@cypress.io>
2023-10-26 14:06:14 -04:00
Ryan Manuel 80cc83d0aa chore: fix test flake with shared workers and correlating on failures (#28132)
Co-authored-by: Cacie Prins <cacieprins@users.noreply.github.com>
2023-10-26 09:17:33 -05:00
Ryan Manuel 15f730007f fix: issue with service worker attachments (#28147)
Co-authored-by: Emily Rohrbough <emilyrohrbough@users.noreply.github.com>
2023-10-26 09:16:20 -05:00
Adam Stone-Lord 09fa9d7a6b chore: update homepage field to point to marketing site (#28133) 2023-10-25 11:36:51 -04:00
Surav Shrestha 186f725da4 docs: fix typos in guides (#28120) 2023-10-24 17:23:04 -04:00
Matt Schile 058f3a80b0 test: fix spec search in windows (#28130) v13.3.3 2023-10-24 12:54:22 -05:00
Matt Schile 7f01e8dffc chore: 13.3.3 release updates (#28129) 2023-10-24 11:32:54 -05:00
Ryan Manuel dbd213926c fix: issue with proxy correlations and web/shared workers (#28105) 2023-10-23 22:26:21 -05:00