Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MWPW-157346:[NALA] Move Nala tests to Milo repository #2795

Merged
merged 54 commits into from
Sep 2, 2024

Conversation

skumar09
Copy link
Contributor

@skumar09 skumar09 commented Aug 27, 2024

Move Nala UI tests to the Milo repository.

  • Define Nala test structures, format, and organization in the Milo repository.
  • Define how to create, run, and debug Nala UI tests from the Milo repository.
  • Provide options to run Nala UI tests on 
    - Local env
    - Libs env
    - Milolibs 
    - Stage, Main, feature branch, or any environments
  • Provide options to run Nala UI tests on multiple browsers/viewports
    • Chrome, Firefox, WebKit browsers
    • Desktop and Mobile viewports

Resolves: MWPW-157346

** Nala Run Command**
image

Test URLs:

Note:

  • This is an initial PR for moving Nala UI tests to Milo Repo,
  • Upon merge of this PR, will start moving other Milo blocks/features UI tests from the Nala repository
  • The object of this PR is also to make sure, the defined folder structure, and update to package.json, are not impacting existing features and functionalities.

Copy link

codecov bot commented Aug 27, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.90%. Comparing base (d90dcc0) to head (960bdc9).
Report is 16 commits behind head on stage.

Additional details and impacted files
@@            Coverage Diff             @@
##            stage    #2795      +/-   ##
==========================================
- Coverage   95.90%   95.90%   -0.01%     
==========================================
  Files         173      173              
  Lines       45842    45842              
==========================================
- Hits        43967    43966       -1     
- Misses       1875     1876       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

This pull request is not passing all required checks. Please see this discussion for information on how to get all checks passing. Inconsistent checks can be manually retried. If a test absolutely can not pass for a good reason, please add a comment with an explanation to the PR.

Santoshkumar Sharanappa Nateekar added 2 commits August 28, 2024 11:21
Copy link
Contributor

aem-code-sync bot commented Aug 28, 2024

Page Scores Audits Google
M /?martech=off PERFORMANCE A11Y SEO BEST PRACTICES SI FCP LCP TBT CLS PSI
D /?martech=off PERFORMANCE A11Y SEO BEST PRACTICES SI FCP LCP TBT CLS PSI

@skumar09 skumar09 added the run-nala Run Nala Test Automation against PR label Aug 28, 2024
Copy link
Contributor

@mokimo mokimo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cool a couple of points and questions:

  • Should we update the workflow to always run on the milo repo?
  • I guess the consumer tests will also be moved soon?

I'd recommend adding the nala folder https://github.com/adobecom/milo/blob/stage/.github/workflows/label-zero-impact.js#L2-L17 to this workflow. Zero-impact PRs are generally mergeable faster and with less hassle.


if (process.env.SLACK_WH) {
try {
await sendSlackMessage(process.env.SLACK_WH, resultSummary);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is the SLACK_WH added to this repo?

const totalTests = this.results.length;
const passPercentage = ((this.passedTests / totalTests) * 100).toFixed(2);
const failPercentage = ((this.failedTests / totalTests) * 100).toFixed(2);
const miloLibs = process.env.MILO_LIBS || '';
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same with the other process variables, have they been added to milo as well?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same with the other process variables, have they been added to milo as well?
-> This process variable is set/updated as part of run-nala-tests-on-milolibs GitHub action flow,

@@ -0,0 +1,71 @@
/* eslint-disable import/no-extraneous-dependencies */
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we move the playwright config file to nala? Since we also use it for WTR, it might lead to confusion otherwise

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mokimo: Once we move all Milo Nala tests, and add/update the GitHub action flow to run Nala tests from the Milo repo, i will move this under the Nala folder or change the file name to nala.config.js

@skumar09
Copy link
Contributor Author

Cool a couple of points and questions:

  • Should we update the workflow to always run on the milo repo?
    -> Yeah, we will enable this once we move all Milo tests from Nala repo to Milo repo.
  • I guess the consumer tests will also be moved soon?
    -> Consumer test to consumer repo movement will take some time,
    I'd recommend adding the nala folder https://github.com/adobecom/milo/blob/stage/.github/workflows/label-zero-impact.js#L2-L17 to this workflow. Zero-impact PRs are generally mergeable faster and with less hassle.
    -> Good idea, yeah we should make zero-impact,

@milo-pr-merge milo-pr-merge bot merged commit 76a1344 into adobecom:stage Sep 2, 2024
20 checks passed
@milo-pr-merge milo-pr-merge bot mentioned this pull request Sep 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Ready for Stage run-nala Run Nala Test Automation against PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants