Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: fix Swap test flakiness on Bitrise #8342

Merged
merged 5 commits into from
Jan 20, 2024
Merged

Conversation

davibroc
Copy link
Contributor

@davibroc davibroc commented Jan 19, 2024

Description

I removed the second swipe to swap action as it wasn't needed anymore and was causing flakiness.

I did 3 regression runs to verify the fix and all passed:
https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/50693ba2-3e80-4b0f-a818-572e4a908a9f
https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/cf8434dd-5da5-444e-9c1b-0e12221f2626
https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/0e16e1ad-5380-4b3f-8a5d-f2a8078d2cd7

Also ran with 3 workers locally. See video of the run here
https://drive.google.com/file/d/1iu-ZceegN1z0BWoix2KsHz-_1Y-xVK8Z/view?usp=sharing

Related issues

Fixes: #8340

Manual testing steps

  1. Go to this page...

Screenshots/Recordings

Before

After

Pre-merge author checklist

  • I’ve followed MetaMask Coding Standards.
  • I've clearly explained what problem this PR is solving and how it is solved.
  • I've linked related issues
  • I've included manual testing steps
  • I've included screenshots/recordings if applicable
  • I’ve included tests if applicable
  • I’ve documented my code using JSDoc format if applicable
  • I’ve applied the right labels on the PR (see labeling guidelines). Not required for external contributors.
  • I’ve properly set the pull request status:
    • In case it's not yet "ready for review", I've set it to "draft".
    • In case it's "ready for review", I've changed it from "draft" to "non-draft".

Pre-merge reviewer checklist

  • I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
  • I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

@davibroc davibroc added team-swaps No E2E Smoke Needed If the PR does not need E2E smoke test run labels Jan 19, 2024
@davibroc davibroc self-assigned this Jan 19, 2024
@davibroc davibroc requested a review from a team as a code owner January 19, 2024 08:01
Copy link
Contributor

CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes.

@davibroc davibroc changed the title test: fix Swap test flakiness test: fix Swap test flakiness on Bitrise Jan 19, 2024
@codecov-commenter
Copy link

codecov-commenter commented Jan 19, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (afcaa91) 40.30% compared to head (c6e57cb) 40.30%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #8342   +/-   ##
=======================================
  Coverage   40.30%   40.30%           
=======================================
  Files        1235     1235           
  Lines       29928    29928           
  Branches     2872     2872           
=======================================
  Hits        12062    12062           
  Misses      17173    17173           
  Partials      693      693           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Andepande
Andepande previously approved these changes Jan 19, 2024
Copy link
Member

@Andepande Andepande left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM Bitrise run is consistent too

@cortisiko cortisiko mentioned this pull request Jan 20, 2024
13 tasks
Copy link

Quality Gate Passed Quality Gate passed

Kudos, no new issues were introduced!

0 New issues
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarCloud

Copy link
Member

@cortisiko cortisiko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🌮🌮🌮🌮

@cortisiko cortisiko merged commit 699ff9f into main Jan 20, 2024
26 checks passed
@cortisiko cortisiko deleted the fix/swap-test-flakyness branch January 20, 2024 17:46
@github-actions github-actions bot locked and limited conversation to collaborators Jan 20, 2024
@metamaskbot metamaskbot added the release-7.16.0 Issue or pull request that will be included in release 7.16.0 label Jan 20, 2024
@metamaskbot metamaskbot added release-7.15.0 Issue or pull request that will be included in release 7.15.0 and removed release-7.16.0 Issue or pull request that will be included in release 7.16.0 labels Jan 29, 2024
@metamaskbot
Copy link
Collaborator

Missing release label release-7.15.0 on PR. Adding release label release-7.15.0 on PR and removing other release labels(release-7.16.0), as PR was cherry-picked in branch 7.15.0.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
E2E No E2E Smoke Needed If the PR does not need E2E smoke test run release-7.15.0 Issue or pull request that will be included in release 7.15.0 team-swaps
Projects
None yet
Development

Successfully merging this pull request may close these issues.

E2E: Swaps tests are flakey on bitrise
6 participants