test(quantic): support e2e testing with LWS and with Locker Service with Playwright #24956
prbot.yml
on: pull_request
Matrix: Run e2e tests on Atomic
Check with linter
4m 15s
Run unit tests
3m 13s
Run e2e screenshots tests on Atomic
4m 51s
Run e2e tests on Atomic React
2m 30s
Run e2e tests on Atomic React NextJS
1m 56s
Run e2e tests for IIFE
12s
Run e2e tests on Atomic Angular
2m 17s
Run e2e tests on Vue.js sample
1m 16s
Run e2e tests on Stencil.js sample
2m 2s
Run e2e tests for Atomic Hosted Page
3m 4s
Run e2e tests for Headless Commerce SSR
2m 29s
Run e2e tests on Atomic insight panel
4m 29s
Run e2e tests on Headless SSR App router sample in dev mode
3m 7s
Run e2e tests on Headless SSR App router sample in prod mode
2m 15s
Run e2e tests on Headless SSR Pages router sample in dev mode
2m 46s
Run e2e tests on Headless SSR Pages router sample in prod mode
2m 19s
Verify compatibility of packages
1m 29s
CDN Checks
4m 42s
Run Quantic E2E tests
/
Setup e2e tests on Quantic
7m 39s
Matrix: Run Playwright tests for Atomic
Matrix: Run Quantic E2E tests / Run Cypress e2e tests on Quantic
Merge Playwright reports
2m 8s
Run Quantic E2E tests
/
Run Playwright e2e tests on Quantic
3m 4s
Confirm build is valid
9s
Annotations
1 error, 20 warnings, and 26 notices
[chromium] › components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts:266:9 › AtomicTabManager › when viewport is too small to display all buttons › when selecting a dropdown option › should change other component visibility › facets:
packages/atomic/src/components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts#L272
1) [chromium] › components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts:266:9 › AtomicTabManager › when viewport is too small to display all buttons › when selecting a dropdown option › should change other component visibility › facets
Error: Timed out 7000ms waiting for expect(locator).toBeVisible()
Locator: locator('atomic-refine-modal').getByLabel(/^included-facet$/).first()
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 7000ms
- waiting for locator('atomic-refine-modal').getByLabel(/^included-facet$/).first()
- locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet>
- unexpected value "hidden"
- locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet>
- unexpected value "hidden"
- locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet>
- unexpected value "hidden"
- locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet>
- unexpected value "hidden"
- locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet>
- unexpected value "hidden"
- locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)" results-must-match="atLeastOneValue"></atomic-facet>
- unexpected value "hidden"
- locator resolved to <atomic-facet with-search="" is-collapsed="" field="filetype" heading-level="0" is-refine-modal="" facet-id="filetype" number-of-values="8" filter-facet-count="" data-atomic-loaded="true" sort-criteria="automatic" aria-label="included-facet" tabs-included="["article"]" data-atomic-rendered="true" display-values-as="checkbox" class="atomic-hidden hydrated" label="File type (included facet)
|
Slow Test:
packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts took 34.1s
|
Slow Test:
packages/atomic/[chromium] › components/search/facets/atomic-facet/e2e/atomic-facet.e2e.ts#L1
packages/atomic/[chromium] › components/search/facets/atomic-facet/e2e/atomic-facet.e2e.ts took 20.7s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-multi-value-text/e2e/atomic-product-multi-value-text.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-multi-value-text/e2e/atomic-product-multi-value-text.e2e.ts took 17.9s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/atomic-commerce-recommendation-list/e2e/atomic-commerce-recommendation-list.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-recommendation-list/e2e/atomic-commerce-recommendation-list.e2e.ts took 16.1s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/atomic-commerce-pager/e2e/atomic-commerce-pager.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-pager/e2e/atomic-commerce-pager.e2e.ts took 27.4s
|
Slow Test:
packages/atomic/[chromium] › components/search/atomic-search-box/e2e/atomic-search-box.e2e.ts#L1
packages/atomic/[chromium] › components/search/atomic-search-box/e2e/atomic-search-box.e2e.ts took 25.7s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts took 36.8s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/atomic-commerce-search-box/e2e/atomic-commerce-search-box.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-search-box/e2e/atomic-commerce-search-box.e2e.ts took 23.3s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/atomic-commerce-search-box/e2e/atomic-commerce-search-box.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-search-box/e2e/atomic-commerce-search-box.e2e.ts took 27.0s
|
Slow Test:
packages/atomic/[chromium] › components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts#L1
packages/atomic/[chromium] › components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts took 39.6s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-excerpt/e2e/atomic-product-excerpt.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-excerpt/e2e/atomic-product-excerpt.e2e.ts took 35.9s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-image/e2e/atomic-product-image.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-image/e2e/atomic-product-image.e2e.ts took 28.7s
|
Slow Test:
packages/atomic/[chromium] › components/search/facets/atomic-timeframe-facet/e2e/atomic-timeframe-facet.e2e.ts#L1
packages/atomic/[chromium] › components/search/facets/atomic-timeframe-facet/e2e/atomic-timeframe-facet.e2e.ts took 22.3s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/atomic-commerce-load-more-products/e2e/atomic-commerce-load-more-products.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-load-more-products/e2e/atomic-commerce-load-more-products.e2e.ts took 19.9s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-breadbox/e2e/atomic-commerce-breadbox.e2e.ts took 44.9s
|
Slow Test:
packages/atomic/[chromium] › components/search/result-template-components/atomic-quickview/e2e/atomic-quickview.e2e.ts#L1
packages/atomic/[chromium] › components/search/result-template-components/atomic-quickview/e2e/atomic-quickview.e2e.ts took 41.2s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-description/e2e/atomic-product-description.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/product-template-components/atomic-product-description/e2e/atomic-product-description.e2e.ts took 42.3s
|
Slow Test:
packages/atomic/[chromium] › components/commerce/atomic-commerce-product-list/e2e/atomic-commerce-product-list.e2e.ts#L1
packages/atomic/[chromium] › components/commerce/atomic-commerce-product-list/e2e/atomic-commerce-product-list.e2e.ts took 35.3s
|
Slow Test:
packages/quantic/[LWS-disabled] › main/default/lwc/quanticPager/e2e/quanticPager.e2e.ts#L1
packages/quantic/[LWS-disabled] › main/default/lwc/quanticPager/e2e/quanticPager.e2e.ts took 31.3s
|
Slow Test:
packages/quantic/[LWS-enabled] › main/default/lwc/quanticPager/e2e/quanticPager.e2e.ts#L1
packages/quantic/[LWS-enabled] › main/default/lwc/quanticPager/e2e/quanticPager.e2e.ts took 24.0s
|
🎭 Playwright Run Summary
23 passed (39.4s)
|
🎭 Playwright Run Summary
23 passed (23.7s)
|
🎭 Playwright Run Summary
7 skipped
16 passed (24.6s)
|
🎭 Playwright Run Summary
23 passed (26.4s)
|
🎭 Playwright Run Summary
23 passed (32.7s)
|
🎭 Playwright Run Summary
24 passed (33.1s)
|
🎭 Playwright Run Summary
24 passed (34.1s)
|
🎭 Playwright Run Summary
23 passed (29.5s)
|
🎭 Playwright Run Summary
23 passed (39.4s)
|
🎭 Playwright Run Summary
24 passed (40.3s)
|
🎭 Playwright Run Summary
24 passed (26.9s)
|
🎭 Playwright Run Summary
23 passed (44.0s)
|
🎭 Playwright Run Summary
24 passed (31.6s)
|
🎭 Playwright Run Summary
24 passed (42.7s)
|
🎭 Playwright Run Summary
23 passed (46.1s)
|
🎭 Playwright Run Summary
23 passed (49.3s)
|
🎭 Playwright Run Summary
23 passed (38.6s)
|
🎭 Playwright Run Summary
23 passed (36.4s)
|
🎭 Playwright Run Summary
23 passed (31.4s)
|
🎭 Playwright Run Summary
24 passed (49.0s)
|
🎭 Playwright Run Summary
24 passed (56.8s)
|
🎭 Playwright Run Summary
23 passed (50.6s)
|
🎭 Playwright Run Summary
23 passed (55.2s)
|
🎭 Playwright Run Summary
24 passed (52.7s)
|
🎭 Playwright Run Summary
1 flaky
[chromium] › components/search/tabs/atomic-tab-manager/e2e/atomic-tab-manager.e2e.ts:266:9 › AtomicTabManager › when viewport is too small to display all buttons › when selecting a dropdown option › should change other component visibility › facets
22 passed (1.2m)
|
🎭 Playwright Run Summary
18 passed (57.0s)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
atomic-hosted-page-playwright-report
Expired
|
184 KB |
|
atomic-playwright-report
Expired
|
1.76 MB |
|
blob-report-1
Expired
|
21.6 KB |
|
blob-report-10
Expired
|
20.4 KB |
|
blob-report-11
Expired
|
24.8 KB |
|
blob-report-12
Expired
|
24.9 KB |
|
blob-report-13
Expired
|
22.4 KB |
|
blob-report-14
Expired
|
20.9 KB |
|
blob-report-15
Expired
|
25.4 KB |
|
blob-report-16
Expired
|
21.2 KB |
|
blob-report-17
Expired
|
18 KB |
|
blob-report-18
Expired
|
23.1 KB |
|
blob-report-19
Expired
|
22.5 KB |
|
blob-report-2
Expired
|
25.9 KB |
|
blob-report-20
Expired
|
21.2 KB |
|
blob-report-21
Expired
|
19.3 KB |
|
blob-report-22
Expired
|
19.6 KB |
|
blob-report-23
Expired
|
23 KB |
|
blob-report-24
Expired
|
1.12 MB |
|
blob-report-3
Expired
|
24.2 KB |
|
blob-report-4
Expired
|
20.5 KB |
|
blob-report-5
Expired
|
31 KB |
|
blob-report-6
Expired
|
22.8 KB |
|
blob-report-7
Expired
|
25.1 KB |
|
blob-report-8
Expired
|
22.5 KB |
|
blob-report-9
Expired
|
22.2 KB |
|
quantic-playwright-blob-report
Expired
|
23.1 KB |
|
result-lists-screenshots
|
23.8 MB |
|