-
-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: add workflow for updating automated test results in TestRail #11424
Merged
+68
−5
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes. |
chrisleewilcox
changed the title
add workflow for updating automated test results in TestRail
feat: add workflow for updating automated test results in TestRail
Sep 24, 2024
This comment was marked as resolved.
This comment was marked as resolved.
chrisleewilcox
added
the
needs-dev-review
PR needs reviews from other engineers (in order to receive required approvals)
label
Nov 14, 2024
chrisleewilcox
added
the
No QA Needed
Apply this label when your PR does not need any QA effort.
label
Nov 14, 2024
chrisleewilcox
commented
Nov 14, 2024
chrisleewilcox
commented
Nov 14, 2024
chrisleewilcox
commented
Nov 14, 2024
chrisleewilcox
commented
Nov 14, 2024
chrisleewilcox
commented
Nov 14, 2024
chrisleewilcox
commented
Nov 14, 2024
chrisleewilcox
commented
Nov 14, 2024
chrisleewilcox
commented
Nov 25, 2024
cortisiko
previously approved these changes
Nov 25, 2024
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🌮 🌮 🌮
Quality Gate passedIssues Measures |
cortisiko
approved these changes
Nov 26, 2024
github-actions
bot
removed
the
needs-dev-review
PR needs reviews from other engineers (in order to receive required approvals)
label
Nov 26, 2024
metamaskbot
added
the
release-7.37.0
Issue or pull request that will be included in release 7.37.0
label
Nov 26, 2024
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Labels
No QA Needed
Apply this label when your PR does not need any QA effort.
release-7.37.0
Issue or pull request that will be included in release 7.37.0
team-mobile-platform
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Adding a workflow to
release_e2e_pipeline
to post test results to TestRail. This initial implementation will focus on utilizing TestRail API to post test results to TestRail mobile project when all workflows in the bitriserelease_e2e_pipeline
are successful. Test results will not be posted if any other workflow fails on therelease_e2e_pipeline
with this implementation.Automated Test Cases in TestRail will need to be reviewed and updated to ensure the most accurate reporting until we implement mapping of automated scripts to automated test cases in TestRail. Once a mapping mechanism has been implemented this will allow us to report failed test runs in a more effective manner.
Not able to run the pipeline from bitrise dashboard until this PR is merged. Test runs for this PR was done using curl command shared in the bitrise advanced modal for the pipeline.
Related issues
Fixes: https://github.com/MetaMask/mobile-planning/issues/1891
Manual testing steps
release_e2e_pipeline
on release branchrelease_e2e_pipeline
are successfulScreenshots/Recordings
Before
No workflow to save test results in TestRail
After
Failed pipeline doesn't post test results: https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/4047bd66-20a1-405b-bd9d-c3e03942bc5a?tab=workflows
Pipeline with disabled workflows: https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/961a7743-e820-4a8a-bcd8-a836c4babb48?tab=workflows
Successful pipeline post test results:
Pre-merge author checklist
Pre-merge reviewer checklist