Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Downgrade browserstack-cypress-cli to fix test failures #842

Merged
merged 5 commits into from
Nov 26, 2021

Conversation

stevehobbsdev
Copy link
Contributor

@stevehobbsdev stevehobbsdev commented Nov 19, 2021

Previously, it turns out that the Browserstack tests were failing on Browserstack but being reported as passing to Circle. The tests were failing thanks to an upgraded version of browserstack-cypress-cli that caused the CLI to exit early, stop the web app being tested, and thus the tests then being unable to run because the web app had shut down.

Pinning to 1.8.1 fixes this.

On the issue of failures not being reported correctly, the CLI seems to return a non-zero exit code even for a passing test suite, so in this command, the --success first flag prevents the build from exiting. However, it means a failing test suite for legitimate reasons does not fail the build.

This will be looked into and queried with the team that author browserstack-cypress-cli.

adamjmcgrath
adamjmcgrath previously approved these changes Nov 19, 2021
@stevehobbsdev stevehobbsdev changed the title All commands in browserstack run must be successful Downgrade browserstack-cypress-cli to fix test failures Nov 19, 2021
stevehobbsdev added 3 commits November 25, 2021 11:00
@stevehobbsdev stevehobbsdev marked this pull request as ready for review November 25, 2021 14:11
@stevehobbsdev stevehobbsdev requested a review from a team as a code owner November 25, 2021 14:11
@@ -21,7 +21,7 @@
"test:watch:integration": "concurrently --raw npm:dev 'npm:test:open:integration'",
"test:es-check": "npm run test:es-check:es5 && npm run test:es-check:es2015:module",
"test:es-check:es5": "es-check es5 'dist/auth0-spa-js.production.js'",
"test:es-check:es2015:module": "es-check es2015 --module 'dist/auth0-spa-js.production.esm.js'",
"test:es-check:es2015:module": "es-check es2015 'dist/auth0-spa-js.production.esm.js' --module ",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There was a bug upgrading es-check to >= 6.1, and this change fixes it. Reported here

@stevehobbsdev stevehobbsdev merged commit 2911c24 into master Nov 26, 2021
@stevehobbsdev stevehobbsdev deleted the fix/browserstack branch November 26, 2021 13:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants