Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: update tests to skip the welcome screen on launchpad tests. #30240

Open
wants to merge 4 commits into
base: develop
Choose a base branch
from

Conversation

jennifer-shehane
Copy link
Member

@jennifer-shehane jennifer-shehane commented Sep 13, 2024

Additional details

I was looking at UI Coverage to find redundant tests and I noticed this [data-cy="major-version-welcome-footer"] element being interacted with 184 times and I thought, hmm...I know we are not wanting to test this button this many times, but it is the starting point of our flow through the App. But the display of this welcome screen is actually conditional.

Screenshot 2024-09-13 at 4 21 12 PM

We should really write tests so the default is to NOT have the welcome screen show and instead have the welcome screen show on the few times we want to test it. I updated the e2e support code to do just that.

It doesn't look like this greatly reduces CI resources (for some specs they ran faster), but this will reduce complexity and reduce instances around flake of this page in our tests.

UI Coverage after:

Screenshot 2024-09-16 at 10 50 50 AM

Steps to test

Tests should pass. Also a review of touched tests would be nice because it's possible false positive could be introduced if the behavior tested isn't the same with the setup introduced.

How has the user experience changed?

N/A

PR Tasks

@jennifer-shehane jennifer-shehane self-assigned this Sep 13, 2024
Copy link

cypress bot commented Sep 13, 2024

cypress    Run #57090

Run Properties:  status check passed Passed #57090  •  git commit 4c8cd5f335: Fix another test
Project cypress
Branch Review remove-welcome-screen-for-testing
Run status status check passed Passed #57090
Run duration 18m 11s
Commit git commit 4c8cd5f335: Fix another test
Committer Jennifer Shehane
View all properties for this run ↗︎

Test results
Tests that failed  Failures 0
Tests that were flaky  Flaky 2
Tests that did not run due to a developer annotating a test with .skip  Pending 73
Tests that did not run due to a failure in a mocha hook  Skipped 0
Tests that passed  Passing 5592
View all changes introduced in this branch ↗︎

Warning

No Report: Something went wrong and we could not generate a report for the Application Quality products.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants