Skip to content

matrix-react-sdk End to End Tests #2197

matrix-react-sdk End to End Tests

matrix-react-sdk End to End Tests #2197

Triggered via merge group November 27, 2024 09:23
Status Success
Total duration 16m 58s
Artifacts 8
Playwright  /  Build Element-Web
2m 6s
Playwright / Build Element-Web
Matrix: Playwright / playwright
Playwright  /  end-to-end-tests
35s
Playwright / end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

8 errors, 30 warnings, and 6 notices
read-receipts/high-level.spec.ts:300:13 › Read receipts › Paging up › After marking room as read based on a thread message: eval at evaluate (:234:30)#L1
1) read-receipts/high-level.spec.ts:300:13 › Read receipts › Paging up › After marking room as read based on a thread message, opening threads view to find old threads that were never read leaves the room read Error: jsHandle.evaluate: TypeError: Cannot read properties of undefined (reading 'roomId') at eval (eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (<anonymous>:236:17) at UtilityScript.<anonymous> (<anonymous>:1:44) at eval (/home/runner/work/matrix-js-sdk/matrix-js-sdk/eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (/home/runner/work/matrix-js-sdk/matrix-js-sdk/<anonymous>:236:17) at UtilityScript.<anonymous> (/home/runner/work/matrix-js-sdk/matrix-js-sdk/<anonymous>:1:44) at Helpers.sendMessageAsClient (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/index.ts:338:35) at Helpers.receiveMessages (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/index.ts:582:9) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/high-level.spec.ts:308:13
read-receipts/high-level.spec.ts:300:13 › Read receipts › Paging up › After marking room as read based on a thread message: playwright/e2e/read-receipts/high-level.spec.ts#L1
1) read-receipts/high-level.spec.ts:300:13 › Read receipts › Paging up › After marking room as read based on a thread message, opening threads view to find old threads that were never read leaves the room read Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read: playwright/e2e/spaces/threads-activity-centre/index.ts#L379
1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read Error: locator.click: Error: strict mode violation: getByLabel('Mark all as read') resolved to 2 elements: 1) <div tabindex="0" role="button" aria-label="Mark all as read" class="mx_AccessibleButton mx_TopUnreadMessagesBar_markAsRead"></div> aka getByRole('main').getByLabel('Mark all as read') 2) <button tabindex="0" role="button" aria-labelledby=":r74:" class="_icon-button_bh2qc_17">…</button> aka locator('#thread-panel').getByLabel('Mark all as read') Call log: - waiting for getByLabel('Mark all as read') at spaces/threads-activity-centre/index.ts:379 377 | */ 378 | clickMarkAllThreadsRead() { > 379 | return this.page.getByLabel("Mark all as read").click(); | ^ 380 | } 381 | } 382 | at Helpers.clickMarkAllThreadsRead (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spaces/threads-activity-centre/index.ts:379:57) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:149:14
spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read: playwright/e2e/spaces/threads-activity-centre/index.ts#L283
1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read Error: expect(locator).toHaveScreenshot(expected) 39 pixels (ratio 0.04 of all image pixels) are different. Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-no-indicator-linux.png Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-ffe63-ld-mark-all-threads-as-read/tac-no-indicator-actual.png Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/test-results/spaces-threads-activity-ce-ffe63-ld-mark-all-threads-as-read/tac-no-indicator-diff.png Call log: - expect.toHaveScreenshot(tac-no-indicator.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads') - locator resolved to <button tabindex="0" type="button" role="button" id="radix-:r8:" data-state="closed" aria-label="Threads" aria-haspopup="menu" aria-expanded="false" aria-disabled="false" aria-labelledby=":ra:" data-indicator="success" class="_icon-button_bh2qc_17 mx_ThreadsActivityCentreButton">…</button> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 39 pixels (ratio 0.04 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads') - locator resolved to <button tabindex="0" type="button" role="button" id="radix-:r8:" data-state="closed" aria-label="Threads" aria-haspopup="menu" aria-expanded="false" aria-disabled="false" aria-labelledby=":ra:" data-indicator="success" class="_icon-button_bh2qc_17 mx_ThreadsActivityCentreButton">…</button> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 39 pixels (ratio 0.04 of all image pixels) are different. at spaces/threads-activity-centre/index.ts:283 281 | await expect(this.getTacButton().locator("[data-indicator='success']")).not.toBeVisible(); 282 | await expect(this.getTacButton().locator("[data-indicator='critical']")).not.toBeVisible(); > 283 | await expect(this.getTacButton()).toMatchScreenshot("tac-no-indicator.png"); | ^ 284 | } 285 | 286 | /** at Helpers.assertNoTacIndicator (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spaces/threads-activity-centre/index.ts:283:43) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:151:9
oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account: playwright/e2e/oidc/oidc-native.spec.ts#L1
1) oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account ─── Test timeout of 90000ms exceeded.
oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account: playwright/e2e/oidc/oidc-native.spec.ts#L23
1) oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account ─── Error: page.waitForRequest: Test timeout of 90000ms exceeded. 21 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => { 22 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`; > 23 | const tokenApiPromise = page.waitForRequest( | ^ 24 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code", 25 | ); 26 | at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/oidc/oidc-native.spec.ts:23:38
pinned-messages/pinned-messages.spec.ts:43:9 › Pinned messages › should pin messages and show them in the room info panel: playwright/e2e/pinned-messages/index.ts#L157
2) pinned-messages/pinned-messages.spec.ts:43:9 › Pinned messages › should pin messages and show them in the room info panel Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: getByRole('menuitem', { name: 'Pinned messages' }) Expected string: "Pinned messages3" Received string: "Pinned messages2" Call log: - expect.toHaveText with timeout 5000ms - waiting for getByRole('menuitem', { name: 'Pinned messages' }) 9 × locator resolved to <button role="menuitem" data-kind="primary" class="_item_8j2l6_17 _interactive_8j2l6_35">…</button> - unexpected value "Pinned messages2" at pinned-messages/index.ts:157 155 | */ 156 | async assertPinnedCountInRoomInfo(count: number) { > 157 | await expect(this.page.getByRole("menuitem", { name: "Pinned messages" })).toHaveText( | ^ 158 | `Pinned messages${count}`, 159 | ); 160 | } at Helpers.assertPinnedCountInRoomInfo (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/pinned-messages/index.ts:157:84) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/pinned-messages/pinned-messages.spec.ts:49:20
crypto/event-shields.spec.ts:274:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted: playwright/e2e/crypto/event-shields.spec.ts#L309
1) crypto/event-shields.spec.ts:274:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible() Locator: locator('.mx_EventTile').filter({ hasText: 'test encrypted from verified' }).locator('.mx_EventTile_e2eIcon') Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for locator('.mx_EventTile').filter({ hasText: 'test encrypted from verified' }).locator('.mx_EventTile_e2eIcon') 9 × locator resolved to <div tabindex="0" aria-labelledby=":r86:" aria-label="State of the end-to-end encryption" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div> - unexpected value "visible" 307 | 308 | const penultimate = page.locator(".mx_EventTile").filter({ hasText: "test encrypted from verified" }); > 309 | await expect(penultimate.locator(".mx_EventTile_e2eIcon")).not.toBeVisible(); | ^ 310 | }); 311 | 312 | test("should show correct shields on events sent by users with changed identity", async ({ at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/crypto/event-shields.spec.ts:309:76
Slow Test: read-receipts/redactions-in-threads.spec.ts#L1
read-receipts/redactions-in-threads.spec.ts took 2.6m
Slow Test: read-receipts/redactions-main-timeline.spec.ts#L1
read-receipts/redactions-main-timeline.spec.ts took 2.1m
Slow Test: read-receipts/new-messages-main-timeline.spec.ts#L1
read-receipts/new-messages-main-timeline.spec.ts took 1.4m
Slow Test: read-receipts/read-receipts.spec.ts#L1
read-receipts/read-receipts.spec.ts took 1.1m
Slow Test: read-receipts/reactions-in-threads.spec.ts#L1
read-receipts/reactions-in-threads.spec.ts took 59.2s
Slow Test: read-receipts/redactions-thread-roots.spec.ts#L1
read-receipts/redactions-thread-roots.spec.ts took 1.1m
Slow Test: spaces/spaces.spec.ts#L1
spaces/spaces.spec.ts took 1.1m
Slow Test: right-panel/right-panel.spec.ts#L1
right-panel/right-panel.spec.ts took 57.7s
Slow Test: settings/account-user-settings-tab.spec.ts#L1
settings/account-user-settings-tab.spec.ts took 46.9s
Slow Test: right-panel/file-panel.spec.ts#L1
right-panel/file-panel.spec.ts took 40.0s
Slow Test: read-receipts/new-messages-in-threads.spec.ts#L1
read-receipts/new-messages-in-threads.spec.ts took 1.7m
Slow Test: read-receipts/editing-messages-main-timeline.spec.ts#L1
read-receipts/editing-messages-main-timeline.spec.ts took 1.2m
Slow Test: read-receipts/editing-messages-in-threads.spec.ts#L1
read-receipts/editing-messages-in-threads.spec.ts took 1.2m
Slow Test: read-receipts/editing-messages-thread-roots.spec.ts#L1
read-receipts/editing-messages-thread-roots.spec.ts took 55.3s
Slow Test: polls/polls.spec.ts#L1
polls/polls.spec.ts took 46.8s
Slow Test: timeline/timeline.spec.ts#L1
timeline/timeline.spec.ts took 2.9m
Slow Test: spotlight/spotlight.spec.ts#L1
spotlight/spotlight.spec.ts took 2.3m
Slow Test: threads/threads.spec.ts#L1
threads/threads.spec.ts took 36.2s
Slow Test: user-onboarding/user-onboarding-new.spec.ts#L1
user-onboarding/user-onboarding-new.spec.ts took 35.7s
Slow Test: widgets/widget-pip-close.spec.ts#L1
widgets/widget-pip-close.spec.ts took 23.4s
Slow Test: messages/messages.spec.ts#L1
messages/messages.spec.ts took 2.4m
Slow Test: login/login.spec.ts#L1
login/login.spec.ts took 1.1m
Slow Test: knock/knock-into-room.spec.ts#L1
knock/knock-into-room.spec.ts took 40.2s
Slow Test: integration-manager/read_events.spec.ts#L1
integration-manager/read_events.spec.ts took 35.8s
Slow Test: knock/manage-knocks.spec.ts#L1
knock/manage-knocks.spec.ts took 30.7s
Slow Test: composer/RTE.spec.ts#L1
composer/RTE.spec.ts took 1.3m
Slow Test: audio-player/audio-player.spec.ts#L1
audio-player/audio-player.spec.ts took 1.3m
Slow Test: crypto/crypto.spec.ts#L1
crypto/crypto.spec.ts took 1.1m
Slow Test: crypto/device-verification.spec.ts#L1
crypto/device-verification.spec.ts took 46.1s
Slow Test: crypto/decryption-failure-messages.spec.ts#L1
crypto/decryption-failure-messages.spec.ts took 40.7s
🎭 Playwright Run Summary
14 skipped 62 passed (10.2m)
🎭 Playwright Run Summary
10 skipped 71 passed (9.9m)
🎭 Playwright Run Summary
1 flaky read-receipts/high-level.spec.ts:300:13 › Read receipts › Paging up › After marking room as read based on a thread message, opening threads view to find old threads that were never read leaves the room read 32 skipped 45 passed (10.1m)
🎭 Playwright Run Summary
1 flaky spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read 3 skipped 68 passed (10.5m)
🎭 Playwright Run Summary
2 flaky oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account ──── pinned-messages/pinned-messages.spec.ts:43:9 › Pinned messages › should pin messages and show them in the room info panel 1 skipped 72 passed (12.2m)
🎭 Playwright Run Summary
1 flaky crypto/event-shields.spec.ts:274:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted 78 passed (12.3m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
3.15 MB
all-blob-reports-2 Expired
7.86 MB
all-blob-reports-3 Expired
10.1 MB
all-blob-reports-4 Expired
333 KB
all-blob-reports-5 Expired
755 KB
all-blob-reports-6 Expired
3.34 MB
html-report Expired
25 MB
webapp Expired
34.2 MB