deps-dev: Bump the testing-library group across 1 directory with 3 updates #2958
dependabot[bot]lint-and-test.yml
on: pull_request
Determine Playwright container image
5s
Lint code
37s
Build package
52s
Lint commit messages
2m 45s
Run unit tests
48s
Audit dependencies
36s
Matrix: test-e2e
Matrix: test-visual-regression
Merge e2e test reports
25s
Merge visual regression reports
24s
Annotations
9 errors, 13 warnings, and 6 notices
|
Audit dependencies
Process completed with exit code 1.
|
|
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header:
e2e/tests/components/header/with-service-name-and-navigation.spec.ts#L1
1) [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header, with service name and navigation › @visual-regression › when JavaScript is enabled › @mobile-and-tablet › matches the saved screenshot when the menu is open
Test timeout of 30000ms exceeded.
|
|
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header:
e2e/tests/components/header/with-service-name-and-navigation.spec.ts#L107
1) [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header, with service name and navigation › @visual-regression › when JavaScript is enabled › @mobile-and-tablet › matches the saved screenshot when the menu is open
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByText('Menu')
- locator resolved to <button hidden="" type="button" aria-controls="navigatio…>Menu</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #21
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #22
- waiting 500ms
- wai
|
|
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header:
e2e/tests/components/header/with-service-name-and-navigation.spec.ts#L1
1) [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header, with service name and navigation › @visual-regression › when JavaScript is enabled › @mobile-and-tablet › matches the saved screenshot when the menu is open
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header:
e2e/tests/components/header/with-service-name-and-navigation.spec.ts#L107
1) [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header, with service name and navigation › @visual-regression › when JavaScript is enabled › @mobile-and-tablet › matches the saved screenshot when the menu is open
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByText('Menu')
- locator resolved to <button hidden="" type="button" aria-controls="navigatio…>Menu</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #21
- waiting 500ms
- waiting for element to be visible, enabled and stable
- e
|
|
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-expanded-items › matches the saved screenshot:
e2e/tests/visual-regression.spec.ts#L14
2) [react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-expanded-items › matches the saved screenshot
Error: Screenshot comparison failed:
Expected an image 1536px by 1372px, received 1536px by 850px. 89320 pixels (ratio 0.05 of all image pixels) are different.
Expected: /__w/moduk-frontend/moduk-frontend/e2e/tests/__screenshots__/visual-regression.spec.ts/accordion/with-expanded-items/screenshot--tablet-safari.png
Received: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-acc-61799-ith-expanded-items-matches-the-saved-screenshot-react-tablet-safari/accordion/with-expanded-items/screenshot-actual.png
Diff: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-acc-61799-ith-expanded-items-matches-the-saved-screenshot-react-tablet-safari/accordion/with-expanded-items/screenshot-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#root > *:first-child')
- locator resolved to <div class="govuk-accordion" data-module="govuk-accor…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1536px by 1372px, received 1536px by 850px. 89320 pixels (ratio 0.05 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#root > *:first-child')
- locator resolved to <div class="govuk-accordion" data-module="govuk-accor…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1536px by 1372px, received 1536px by 850px. 89320 pixels (ratio 0.05 of all image pixels) are different.
12 |
13 | test('matches the saved screenshot', async ({ componentElement }) => {
> 14 | await expect(componentElement).toHaveScreenshot([
| ^
15 | component,
16 | exampleName,
17 | 'screenshot.png',
at /__w/moduk-frontend/moduk-frontend/e2e/tests/visual-regression.spec.ts:14:44
|
|
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-summary-lines › matches the saved screenshot:
e2e/tests/visual-regression.spec.ts#L14
3) [react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-summary-lines › matches the saved screenshot
Error: Screenshot comparison failed:
Expected an image 1536px by 1316px, received 1536px by 794px. 110924 pixels (ratio 0.06 of all image pixels) are different.
Expected: /__w/moduk-frontend/moduk-frontend/e2e/tests/__screenshots__/visual-regression.spec.ts/accordion/with-summary-lines/screenshot--tablet-safari.png
Received: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-accordion-with-summary-lines-matches-the-saved-screenshot-react-tablet-safari/accordion/with-summary-lines/screenshot-actual.png
Diff: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-accordion-with-summary-lines-matches-the-saved-screenshot-react-tablet-safari/accordion/with-summary-lines/screenshot-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#root > *:first-child')
- locator resolved to <div class="govuk-accordion" data-module="govuk-accor…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1536px by 1316px, received 1536px by 794px. 110924 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#root > *:first-child')
- locator resolved to <div class="govuk-accordion" data-module="govuk-accor…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1536px by 1316px, received 1536px by 794px. 110924 pixels (ratio 0.06 of all image pixels) are different.
12 |
13 | test('matches the saved screenshot', async ({ componentElement }) => {
> 14 | await expect(componentElement).toHaveScreenshot([
| ^
15 | component,
16 | exampleName,
17 | 'screenshot.png',
at /__w/moduk-frontend/moduk-frontend/e2e/tests/visual-regression.spec.ts:14:44
|
|
Run visual regression tests (2/2)
Process completed with exit code 1.
|
|
Run visual regression tests (1/2)
The job was canceled because "_2_2" failed.
|
|
🎭 Playwright Run Summary
479 passed (2.3m)
|
|
🎭 Playwright Run Summary
478 passed (2.5m)
|
|
🎭 Playwright Run Summary
1 failed
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header, with service name and navigation › @visual-regression › when JavaScript is enabled › @mobile-and-tablet › matches the saved screenshot when the menu is open
2 flaky
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-expanded-items › matches the saved screenshot
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-summary-lines › matches the saved screenshot
443 passed (3.1m)
|
|
🎭 Playwright Run Summary
446 passed (2.0m)
|
|
🎭 Playwright Run Summary
478 passed (3.6m)
|
|
🎭 Playwright Run Summary
478 passed (3.9m)
|
|
Lint code
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Audit dependencies
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Run unit tests
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Build package
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Lint commit messages
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Run e2e tests (1/4)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Run e2e tests (3/4)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Run visual regression tests (2/2)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Run e2e tests (2/4)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Merge visual regression reports
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/download-artifact@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Run e2e tests (4/4)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Merge e2e test reports
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/download-artifact@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "e2e-blob-reports", "e2e-html-report", "visual-regression-blob-reports", "visual-regression-html-report".
Please update your workflow to use v4 of the artifact actions.
Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
e2e-blob-reports
Expired
|
1.36 MB |
|
|
e2e-html-report
|
972 KB |
|
|
visual-regression-blob-reports
Expired
|
1.37 MB |
|
|
visual-regression-html-report
|
2.45 MB |
|