Skip to content

test(quantic): support e2e testing with LWS and with Locker Service with Playwright #24956

test(quantic): support e2e testing with LWS and with Locker Service with Playwright

test(quantic): support e2e testing with LWS and with Locker Service with Playwright #24956

Triggered via pull request November 27, 2024 03:38
@mmitichemmitiche
synchronize #4711
SFINT-5796
Status Success
Total duration 34m 51s
Artifacts 28

prbot.yml

on: pull_request
Matrix: Run e2e tests on Atomic
Check with linter
4m 15s
Check with linter
Run unit tests
3m 13s
Run unit tests
Run e2e screenshots tests on Atomic
4m 51s
Run e2e screenshots tests on Atomic
Run e2e tests on Atomic React
2m 30s
Run e2e tests on Atomic React
Run e2e tests on Atomic React NextJS
1m 56s
Run e2e tests on Atomic React NextJS
Run e2e tests for IIFE
12s
Run e2e tests for IIFE
Run e2e tests on Atomic Angular
2m 17s
Run e2e tests on Atomic Angular
Run e2e tests on Vue.js sample
1m 16s
Run e2e tests on Vue.js sample
Run e2e tests on Stencil.js sample
2m 2s
Run e2e tests on Stencil.js sample
Run e2e tests for Atomic Hosted Page
3m 4s
Run e2e tests for Atomic Hosted Page
Run e2e tests for Headless Commerce SSR
2m 29s
Run e2e tests for Headless Commerce SSR
Run e2e tests on Atomic insight panel
4m 29s
Run e2e tests on Atomic insight panel
Run e2e tests on Headless SSR App router sample in dev mode
3m 7s
Run e2e tests on Headless SSR App router sample in dev mode
Run e2e tests on Headless SSR App router sample in prod mode
2m 15s
Run e2e tests on Headless SSR App router sample in prod mode
Run e2e tests on Headless SSR Pages router sample in dev mode
2m 46s
Run e2e tests on Headless SSR Pages router sample in dev mode
Run e2e tests on Headless SSR Pages router sample in prod mode
2m 19s
Run e2e tests on Headless SSR Pages router sample in prod mode
Should test Quantic?
1m 51s
Should test Quantic?
Run e2e tests on Atomic CSP
3m 18s
Run e2e tests on Atomic CSP
Determine Playwright E2E tests to run
1m 57s
Determine Playwright E2E tests to run
Verify compatibility of packages
1m 29s
Verify compatibility of packages
Run Quantic E2E tests  /  Setup e2e tests on Quantic
7m 39s
Run Quantic E2E tests / Setup e2e tests on Quantic
Matrix: Run Playwright tests for Atomic
Matrix: Run Quantic E2E tests / Run Cypress e2e tests on Quantic
Confirm build is valid (merge group)
0s
Confirm build is valid (merge group)
Merge Playwright reports
2m 8s
Merge Playwright reports
Run Quantic E2E tests  /  Run Playwright e2e tests on Quantic
3m 4s
Run Quantic E2E tests / Run Playwright e2e tests on Quantic
Run Quantic E2E tests  /  e2e-quantic-cleanup
1m 50s
Run Quantic E2E tests / e2e-quantic-cleanup
Confirm build is valid (PR)
9s
Confirm build is valid (PR)
Confirm build is valid
9s
Confirm build is valid
Fit to window
Zoom out
Zoom in

Annotations

1 error, 20 warnings, and 26 notices
[chromium] › components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts:266:9 › AtomicTabManager › when viewport is too small to display all buttons › when selecting a dropdown option › should change other component visibility › facets: packages/atomic/src/components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts#L272
1) [chromium] › components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts:266:9 › AtomicTabManager › when viewport is too small to display all buttons › when selecting a dropdown option › should change other component visibility › facets Error: Timed out 7000ms waiting for expect(locator).toBeVisible() Locator: locator('atomic-refine-modal').getByLabel(/^included-facet$/).first() Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 7000ms - waiting for locator('atomic-refine-modal').getByLabel(/^included-facet$/).first() - locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet> - unexpected value "hidden" - locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet> - unexpected value "hidden" - locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet> - unexpected value "hidden" - locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet> - unexpected value "hidden" - locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet> - unexpected value "hidden" - locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet> - unexpected value "hidden" - locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)
Slow Test: packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts took 34.1s
Slow Test: packages/atomic/[chromium] › components/search/facets/atomic-facet/e2e/atomic-facet.e2e.ts#L1
packages/atomic/[chromium] › components/search/facets/atomic-facet/e2e/atomic-facet.e2e.ts took 20.7s
Slow Test: packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-multi-value-text/e2e/atomic-product-multi-value-text.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-multi-value-text/e2e/atomic-product-multi-value-text.e2e.ts took 17.9s
Slow Test: packages/atomic/[chromium] › components/commerce/atomic-commerce-recommendation-list/e2e/atomic-commerce-recommendation-list.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-recommendation-list/e2e/atomic-commerce-recommendation-list.e2e.ts took 16.1s
Slow Test: packages/atomic/[chromium] › components/commerce/atomic-commerce-pager/e2e/atomic-commerce-pager.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-pager/e2e/atomic-commerce-pager.e2e.ts took 27.4s
Slow Test: packages/atomic/[chromium] › components/search/atomic-search-box/e2e/atomic-search-box.e2e.ts#L1
packages/atomic/[chromium] › components/search/atomic-search-box/e2e/atomic-search-box.e2e.ts took 25.7s
Slow Test: packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts took 36.8s
Slow Test: packages/atomic/[chromium] › components/commerce/atomic-commerce-search-box/e2e/atomic-commerce-search-box.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-search-box/e2e/atomic-commerce-search-box.e2e.ts took 23.3s
Slow Test: packages/atomic/[chromium] › components/commerce/atomic-commerce-search-box/e2e/atomic-commerce-search-box.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-search-box/e2e/atomic-commerce-search-box.e2e.ts took 27.0s
Slow Test: packages/atomic/[chromium] › components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts#L1
packages/atomic/[chromium] › components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts took 39.6s
Slow Test: packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-excerpt/e2e/atomic-product-excerpt.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-excerpt/e2e/atomic-product-excerpt.e2e.ts took 35.9s
Slow Test: packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-image/e2e/atomic-product-image.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-image/e2e/atomic-product-image.e2e.ts took 28.7s
Slow Test: packages/atomic/[chromium] › components/search/facets/atomic-timeframe-facet/e2e/atomic-timeframe-facet.e2e.ts#L1
packages/atomic/[chromium] › components/search/facets/atomic-timeframe-facet/e2e/atomic-timeframe-facet.e2e.ts took 22.3s
Slow Test: packages/atomic/[chromium] › components/commerce/atomic-commerce-load-more-products/e2e/atomic-commerce-load-more-products.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-load-more-products/e2e/atomic-commerce-load-more-products.e2e.ts took 19.9s
Slow Test: packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts took 44.9s
Slow Test: packages/atomic/[chromium] › components/search/result-template-components/atomic-quickview/e2e/atomic-quickview.e2e.ts#L1
packages/atomic/[chromium] › components/search/result-template-components/atomic-quickview/e2e/atomic-quickview.e2e.ts took 41.2s
Slow Test: packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-description/e2e/atomic-product-description.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-description/e2e/atomic-product-description.e2e.ts took 42.3s
Slow Test: packages/atomic/[chromium] › components/commerce/atomic-commerce-product-list/e2e/atomic-commerce-product-list.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-product-list/e2e/atomic-commerce-product-list.e2e.ts took 35.3s
Slow Test: packages/quantic/[LWS-disabled] › main/default/lwc/quanticPager/e2e/quanticPager.e2e.ts#L1
packages/quantic/[LWS-disabled] › main/default/lwc/quanticPager/e2e/quanticPager.e2e.ts took 31.3s
Slow Test: packages/quantic/[LWS-enabled] › main/default/lwc/quanticPager/e2e/quanticPager.e2e.ts#L1
packages/quantic/[LWS-enabled] › main/default/lwc/quanticPager/e2e/quanticPager.e2e.ts took 24.0s
🎭 Playwright Run Summary
23 passed (39.4s)
🎭 Playwright Run Summary
23 passed (23.7s)
🎭 Playwright Run Summary
7 skipped 16 passed (24.6s)
🎭 Playwright Run Summary
23 passed (26.4s)
🎭 Playwright Run Summary
23 passed (32.7s)
🎭 Playwright Run Summary
24 passed (33.1s)
🎭 Playwright Run Summary
24 passed (34.1s)
🎭 Playwright Run Summary
23 passed (29.5s)
🎭 Playwright Run Summary
23 passed (39.4s)
🎭 Playwright Run Summary
24 passed (40.3s)
🎭 Playwright Run Summary
24 passed (26.9s)
🎭 Playwright Run Summary
23 passed (44.0s)
🎭 Playwright Run Summary
24 passed (31.6s)
🎭 Playwright Run Summary
24 passed (42.7s)
🎭 Playwright Run Summary
23 passed (46.1s)
🎭 Playwright Run Summary
23 passed (49.3s)
🎭 Playwright Run Summary
23 passed (38.6s)
🎭 Playwright Run Summary
23 passed (36.4s)
🎭 Playwright Run Summary
23 passed (31.4s)
🎭 Playwright Run Summary
24 passed (49.0s)
🎭 Playwright Run Summary
24 passed (56.8s)
🎭 Playwright Run Summary
23 passed (50.6s)
🎭 Playwright Run Summary
23 passed (55.2s)
🎭 Playwright Run Summary
24 passed (52.7s)
🎭 Playwright Run Summary
1 flaky [chromium] › components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts:266:9 › AtomicTabManager › when viewport is too small to display all buttons › when selecting a dropdown option › should change other component visibility › facets 22 passed (1.2m)
🎭 Playwright Run Summary
18 passed (57.0s)

Artifacts

Produced during runtime
Name Size
atomic-hosted-page-playwright-report Expired
184 KB
atomic-playwright-report Expired
1.76 MB
blob-report-1 Expired
21.6 KB
blob-report-10 Expired
20.4 KB
blob-report-11 Expired
24.8 KB
blob-report-12 Expired
24.9 KB
blob-report-13 Expired
22.4 KB
blob-report-14 Expired
20.9 KB
blob-report-15 Expired
25.4 KB
blob-report-16 Expired
21.2 KB
blob-report-17 Expired
18 KB
blob-report-18 Expired
23.1 KB
blob-report-19 Expired
22.5 KB
blob-report-2 Expired
25.9 KB
blob-report-20 Expired
21.2 KB
blob-report-21 Expired
19.3 KB
blob-report-22 Expired
19.6 KB
blob-report-23 Expired
23 KB
blob-report-24 Expired
1.12 MB
blob-report-3 Expired
24.2 KB
blob-report-4 Expired
20.5 KB
blob-report-5 Expired
31 KB
blob-report-6 Expired
22.8 KB
blob-report-7 Expired
25.1 KB
blob-report-8 Expired
22.5 KB
blob-report-9 Expired
22.2 KB
quantic-playwright-blob-report Expired
23.1 KB
result-lists-screenshots
23.8 MB