This repository has been archived by the owner on Sep 11, 2024. It is now read-only.
Upload End to End Test report to Netlify #304
Annotations
10 errors, 6 warnings, and 1 notice
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
1) [Legacy Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ────────
Error: Screenshot comparison failed:
1010 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto/apps-drawer-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto/apps-drawer-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 1010 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 1010 pixels (ratio 0.01 of all image pixels) are different.
80 |
81 | test("should be set properly", async ({ page }) => {
> 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png");
| ^
83 | });
84 |
85 | test("manually resize the height of the top container layout", async ({ page }) => {
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
1) [Legacy Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
1010 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto-retry1/apps-drawer-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto-retry1/apps-drawer-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 1010 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 1010 pixels (ratio 0.01 of all image pixels) are different.
80 |
81 | test("should be set properly", async ({ page }) => {
> 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png");
| ^
83 | });
84 |
85 | test("manually resize the height of the top container layout", async ({ page }) => {
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
1) [Legacy Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
1010 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto-retry2/apps-drawer-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Legacy-Crypto-retry2/apps-drawer-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 1010 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 1010 pixels (ratio 0.01 of all image pixels) are different.
80 |
81 | test("should be set properly", async ({ page }) => {
> 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png");
| ^
83 | });
84 |
85 | test("manually resize the height of the top container layout", async ({ page }) => {
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
2) [Rust Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ──────────
Error: Screenshot comparison failed:
1010 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto/apps-drawer-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto/apps-drawer-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 1010 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 1010 pixels (ratio 0.01 of all image pixels) are different.
80 |
81 | test("should be set properly", async ({ page }) => {
> 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png");
| ^
83 | });
84 |
85 | test("manually resize the height of the top container layout", async ({ page }) => {
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
2) [Rust Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ──────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
1010 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto-retry1/apps-drawer-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto-retry1/apps-drawer-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 1010 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 1010 pixels (ratio 0.01 of all image pixels) are different.
80 |
81 | test("should be set properly", async ({ page }) => {
> 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png");
| ^
83 | });
84 |
85 | test("manually resize the height of the top container layout", async ({ page }) => {
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts#L82
2) [Rust Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ──────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
1010 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/widgets/layout.spec.ts/apps-drawer-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto-retry2/apps-drawer-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/widgets-layout-Widget-Layout-should-be-set-properly-Rust-Crypto-retry2/apps-drawer-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 1010 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_AppsDrawer')
- locator resolved to <div class="mx_AppsDrawer">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 1010 pixels (ratio 0.01 of all image pixels) are different.
80 |
81 | test("should be set properly", async ({ page }) => {
> 82 | await expect(page.locator(".mx_AppsDrawer")).toMatchScreenshot("apps-drawer.png");
| ^
83 | });
84 |
85 | test("manually resize the height of the top container layout", async ({ page }) => {
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/widgets/layout.spec.ts:82:54
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts#L133
3) [Legacy Crypto] › audio-player/audio-player.spec.ts:145:9 › Audio player › should be correctly rendered - light theme
Test timeout of 30000ms exceeded while running "beforeEach" hook.
131 | };
132 |
> 133 | test.beforeEach(async ({ page, app, user }) => {
| ^
134 | await app.client.createRoom({ name: "Test Room" });
135 | await app.viewRoomByName("Test Room");
136 |
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts:133:10
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/crypto/crypto.spec.ts#L172
4) [Legacy Crypto] › crypto/crypto.spec.ts:149:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys')
170 | if (!isDeviceVerified) {
171 | const uiaDialogTitle = page.locator(".mx_InteractiveAuthDialog .mx_Dialog_title");
> 172 | await expect(uiaDialogTitle.getByText("Setting up keys")).toBeVisible();
| ^
173 | await expect(uiaDialogTitle.getByText("Setting up keys")).not.toBeVisible();
174 | }
175 |
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/crypto.spec.ts:172:79
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/register/email.spec.ts#L55
5) [Legacy Crypto] › register/email.spec.ts:49:9 › Email Registration › registers an account and lands on the use case selection screen
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByRole('textbox', { name: 'Username' })
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByRole('textbox', { name: 'Username' })
53 | checkA11y,
54 | }) => {
> 55 | await expect(page.getByRole("textbox", { name: "Username" })).toBeVisible();
| ^
56 | // Hide the server text as it contains the randomly allocated Homeserver port
57 | const screenshotOptions = { mask: [page.locator(".mx_ServerPicker_server")] };
58 |
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/email.spec.ts:55:71
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/user-onboarding/user-onboarding-new.spec.ts#L48
6) [Legacy Crypto] › user-onboarding/user-onboarding-new.spec.ts:43:9 › User Onboarding (new user) › app download dialog
Error: Screenshot comparison failed:
129 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/user-onboarding/user-onboarding-new.spec.ts/User-Onboarding-new-user-app-download-dialog-1-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/user-onboarding-user-onboa-8144a-ew-user-app-download-dialog-Legacy-Crypto/User-Onboarding-new-user-app-download-dialog-1-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/user-onboarding-user-onboa-8144a-ew-user-app-download-dialog-Legacy-Crypto/User-Onboarding-new-user-app-download-dialog-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_Dialog')
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 129 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_Dialog')
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 129 pixels (ratio 0.01 of all image pixels) are different.
46 | page.getByRole("dialog").getByRole("heading", { level: 1, name: "Download Element" }),
47 | ).toBeVisible();
> 48 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot();
| ^
49 | });
50 |
51 | test("using find friends action should increase progress", async ({ page, homeserver }) => {
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/user-onboarding/user-onboarding-new.spec.ts:48:50
|
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: bobheadxi/deployments@88ce5600046c82542f8246ac287d0a53c461bca3, actions/github-script@v6, nwtgck/actions-netlify@7a92f00dde8c92a5a9e8385ec2919775f7647352. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Merge into HTML Report:
[Rust Crypto] › read-receipts/redactions.spec.ts#L1
[Rust Crypto] › read-receipts/redactions.spec.ts took 5.6m
|
Merge into HTML Report:
[Legacy Crypto] › read-receipts/redactions.spec.ts#L1
[Legacy Crypto] › read-receipts/redactions.spec.ts took 5.3m
|
Merge into HTML Report:
[Rust Crypto] › read-receipts/new-messages.spec.ts#L1
[Rust Crypto] › read-receipts/new-messages.spec.ts took 3.7m
|
Merge into HTML Report:
[Rust Crypto] › read-receipts/high-level.spec.ts#L1
[Rust Crypto] › read-receipts/high-level.spec.ts took 3.6m
|
Merge into HTML Report:
[Rust Crypto] › read-receipts/editing-messages.spec.ts#L1
[Rust Crypto] › read-receipts/editing-messages.spec.ts took 3.5m
|
Merge into HTML Report
2 failed
[Legacy Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ─────────
[Rust Crypto] › widgets/layout.spec.ts:81:9 › Widget Layout › should be set properly ───────────
6 flaky
[Legacy Crypto] › audio-player/audio-player.spec.ts:145:9 › Audio player › should be correctly rendered - light theme
[Legacy Crypto] › crypto/crypto.spec.ts:149:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code
[Legacy Crypto] › register/email.spec.ts:49:9 › Email Registration › registers an account and lands on the use case selection screen
[Legacy Crypto] › user-onboarding/user-onboarding-new.spec.ts:43:9 › User Onboarding (new user) › app download dialog
[Rust Crypto] › crypto/crypto.spec.ts:149:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code
[Rust Crypto] › login/overwrite_login.spec.ts:21:9 › Overwrite login action › Try replace existing login with new one
129 skipped
669 passed (17.3m)
|
Loading