Skip to content
This repository has been archived by the owner on Sep 11, 2024. It is now read-only.

Upload End to End Test report to Netlify #304

Upload End to End Test report to Netlify

Upload End to End Test report to Netlify #304

Triggered via workflow run May 8, 2024 12:30
@MidhunSureshRMidhunSureshR
completed 51a5436
Status Success
Total duration 52s
Artifacts 1
Report results
43s
Report results
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 6 warnings, and 1 notice
[Legacy Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly: matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
1) [Legacy Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ──────── Error: Screenshot comparison failed: 1010 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto/apps-drawer-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto/apps-drawer-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1010 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1010 pixels (ratio 0.01 of all image pixels) are different. 80 | 81 | test("should be set properly", async ({ page }) => { > 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png"); | ^ 83 | }); 84 | 85 | test("manually resize the height of the top container layout", async ({ page }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
[Legacy Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly: matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
1) [Legacy Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ──────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1010 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto-retry1/apps-drawer-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto-retry1/apps-drawer-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1010 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1010 pixels (ratio 0.01 of all image pixels) are different. 80 | 81 | test("should be set properly", async ({ page }) => { > 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png"); | ^ 83 | }); 84 | 85 | test("manually resize the height of the top container layout", async ({ page }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
[Legacy Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly: matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
1) [Legacy Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ──────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1010 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto-retry2/apps-drawer-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto-retry2/apps-drawer-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1010 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1010 pixels (ratio 0.01 of all image pixels) are different. 80 | 81 | test("should be set properly", async ({ page }) => { > 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png"); | ^ 83 | }); 84 | 85 | test("manually resize the height of the top container layout", async ({ page }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
[Rust Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly: matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
2) [Rust Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ────────── Error: Screenshot comparison failed: 1010 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto/apps-drawer-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto/apps-drawer-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1010 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1010 pixels (ratio 0.01 of all image pixels) are different. 80 | 81 | test("should be set properly", async ({ page }) => { > 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png"); | ^ 83 | }); 84 | 85 | test("manually resize the height of the top container layout", async ({ page }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
[Rust Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly: matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
2) [Rust Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1010 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto-retry1/apps-drawer-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto-retry1/apps-drawer-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1010 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1010 pixels (ratio 0.01 of all image pixels) are different. 80 | 81 | test("should be set properly", async ({ page }) => { > 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png"); | ^ 83 | }); 84 | 85 | test("manually resize the height of the top container layout", async ({ page }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
[Rust Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly: matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
2) [Rust Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1010 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto-retry2/apps-drawer-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto-retry2/apps-drawer-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 1010 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_AppsDrawer') - locator resolved to <div class="mx_AppsDrawer">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 1010 pixels (ratio 0.01 of all image pixels) are different. 80 | 81 | test("should be set properly", async ({ page }) => { > 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png"); | ^ 83 | }); 84 | 85 | test("manually resize the height of the top container layout", async ({ page }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
[Legacy Crypto] › audio-player/audio-player.spec.ts:145:9 › Audio player › should be correctly rendered - light theme: matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts#L133
3) [Legacy Crypto] › audio-player/audio-player.spec.ts:145:9 › Audio player › should be correctly rendered - light theme Test timeout of 30000ms exceeded while running "beforeEach" hook. 131 | }; 132 | > 133 | test.beforeEach(async ({ page, app, user }) => { | ^ 134 | await app.client.createRoom({ name: "Test Room" }); 135 | await app.viewRoomByName("Test Room"); 136 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts:133:10
[Legacy Crypto] › crypto/crypto.spec.ts:149:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code: matrix-react-sdk/playwright/e2e/crypto/crypto.spec.ts#L172
4) [Legacy Crypto] › crypto/crypto.spec.ts:149:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') 170 | if (!isDeviceVerified) { 171 | const uiaDialogTitle = page.locator(".mx_InteractiveAuthDialog .mx_Dialog_title"); > 172 | await expect(uiaDialogTitle.getByText("Setting up keys")).toBeVisible(); | ^ 173 | await expect(uiaDialogTitle.getByText("Setting up keys")).not.toBeVisible(); 174 | } 175 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/crypto.spec.ts:172:79
[Legacy Crypto] › register/email.spec.ts:49:9 › Email Registration › registers an account and lands on the use case selection screen: matrix-react-sdk/playwright/e2e/register/email.spec.ts#L55
5) [Legacy Crypto] › register/email.spec.ts:49:9 › Email Registration › registers an account and lands on the use case selection screen Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('textbox', { name: 'Username' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('textbox', { name: 'Username' }) 53 | checkA11y, 54 | }) => { > 55 | await expect(page.getByRole("textbox", { name: "Username" })).toBeVisible(); | ^ 56 | // Hide the server text as it contains the randomly allocated Homeserver port 57 | const screenshotOptions = { mask: [page.locator(".mx_ServerPicker_server")] }; 58 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/email.spec.ts:55:71
[Legacy Crypto] › user-onboarding/user-onboarding-new.spec.ts:43:9 › User Onboarding (new user) › app download dialog: matrix-react-sdk/playwright/e2e/user-onboarding/user-onboarding-new.spec.ts#L48
6) [Legacy Crypto] › user-onboarding/user-onboarding-new.spec.ts:43:9 › User Onboarding (new user) › app download dialog Error: Screenshot comparison failed: 129 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/user-onboarding/user-onboarding-new.spec.ts/User-Onboarding-new-user-app-download-dialog-1-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/user-onboarding-user-onboa-8144a-ew-user-app-download-dialog-Legacy-Crypto/User-Onboarding-new-user-app-download-dialog-1-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/user-onboarding-user-onboa-8144a-ew-user-app-download-dialog-Legacy-Crypto/User-Onboarding-new-user-app-download-dialog-1-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 129 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 129 pixels (ratio 0.01 of all image pixels) are different. 46 | page.getByRole("dialog").getByRole("heading", { level: 1, name: "Download Element" }), 47 | ).toBeVisible(); > 48 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot(); | ^ 49 | }); 50 | 51 | test("using find friends action should increase progress", async ({ page, homeserver }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/user-onboarding/user-onboarding-new.spec.ts:48:50
Report results
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: bobheadxi/deployments@88ce5600046c82542f8246ac287d0a53c461bca3, actions/github-script@v6, nwtgck/actions-netlify@7a92f00dde8c92a5a9e8385ec2919775f7647352. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: [Rust Crypto] › read-receipts/redactions.spec.ts#L1
[Rust Crypto] › read-receipts/redactions.spec.ts took 5.6m
Slow Test: [Legacy Crypto] › read-receipts/redactions.spec.ts#L1
[Legacy Crypto] › read-receipts/redactions.spec.ts took 5.3m
Slow Test: [Rust Crypto] › read-receipts/new-messages.spec.ts#L1
[Rust Crypto] › read-receipts/new-messages.spec.ts took 3.7m
Slow Test: [Rust Crypto] › read-receipts/high-level.spec.ts#L1
[Rust Crypto] › read-receipts/high-level.spec.ts took 3.6m
Slow Test: [Rust Crypto] › read-receipts/editing-messages.spec.ts#L1
[Rust Crypto] › read-receipts/editing-messages.spec.ts took 3.5m
🎭 Playwright Run Summary
2 failed [Legacy Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ───────── [Rust Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ─────────── 6 flaky [Legacy Crypto] › audio-player/audio-player.spec.ts:145:9 › Audio player › should be correctly rendered - light theme [Legacy Crypto] › crypto/crypto.spec.ts:149:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code [Legacy Crypto] › register/email.spec.ts:49:9 › Email Registration › registers an account and lands on the use case selection screen [Legacy Crypto] › user-onboarding/user-onboarding-new.spec.ts:43:9 › User Onboarding (new user) › app download dialog [Rust Crypto] › crypto/crypto.spec.ts:149:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code [Rust Crypto] › login/overwrite_login.spec.ts:21:9 › Overwrite login action › Try replace existing login with new one 129 skipped 669 passed (17.3m)

Artifacts

Produced during runtime
Name Size
html-report--attempt-1 Expired
33.8 MB