Bump the pip group across 1 directory with 5 updates #397
galata.yml
on: pull_request
Visual Regression Tests
40m 22s
Matrix: Visual Regression Documentation
Annotations
16 errors and 2 notices
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L88
1) [documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ─────────────────
Error: Screenshot comparison failed:
11949 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts-snapshots/jupyterlab-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Welcome-documentation/jupyterlab-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Welcome-documentation/jupyterlab-diff.png
86 | .waitFor();
87 |
> 88 | expect(await page.screenshot()).toMatchSnapshot('jupyterlab.png');
| ^
89 | });
90 |
91 | test('Left Sidebar', async ({ page }) => {
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:88:37
|
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L88
1) [documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ─────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
11949 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts-snapshots/jupyterlab-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Welcome-documentation-retry1/jupyterlab-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Welcome-documentation-retry1/jupyterlab-diff.png
86 | .waitFor();
87 |
> 88 | expect(await page.screenshot()).toMatchSnapshot('jupyterlab.png');
| ^
89 | });
90 |
91 | test('Left Sidebar', async ({ page }) => {
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:88:37
|
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L88
1) [documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ─────────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
11949 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts-snapshots/jupyterlab-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Welcome-documentation-retry2/jupyterlab-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Welcome-documentation-retry2/jupyterlab-diff.png
86 | .waitFor();
87 |
> 88 | expect(await page.screenshot()).toMatchSnapshot('jupyterlab.png');
| ^
89 | });
90 |
91 | test('Left Sidebar', async ({ page }) => {
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:88:37
|
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L581
2) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('.jp-RunningSessions-item.jp-mod-kernel')
Expected: 2
Received: 4
Call log:
- expect.soft.toHaveCount with timeout 5000ms
- waiting for locator('.jp-RunningSessions-item.jp-mod-kernel')
- locator resolved to 3 elements
- unexpected value "3"
- locator resolved to 3 elements
- unexpected value "3"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
579 | await expect
580 | .soft(page.locator('.jp-RunningSessions-item.jp-mod-kernel'))
> 581 | .toHaveCount(2, { timeout: 5000 });
| ^
582 |
583 | const freeezeKernelIds = async () => {
584 | return page.evaluate(() => {
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:581:8
|
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L601
2) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Error: Screenshot comparison failed:
948 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts-snapshots/running-layout-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation/running-layout-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation/running-layout-diff.png
599 | })
600 | )
> 601 | .toMatchSnapshot('running_layout.png');
| ^
602 |
603 | await page.click('jp-button[data-command="running:show-modal"]');
604 | await freeezeKernelIds();
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:601:8
|
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L581
2) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('.jp-RunningSessions-item.jp-mod-kernel')
Expected: 2
Received: 4
Call log:
- expect.soft.toHaveCount with timeout 5000ms
- waiting for locator('.jp-RunningSessions-item.jp-mod-kernel')
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
579 | await expect
580 | .soft(page.locator('.jp-RunningSessions-item.jp-mod-kernel'))
> 581 | .toHaveCount(2, { timeout: 5000 });
| ^
582 |
583 | const freeezeKernelIds = async () => {
584 | return page.evaluate(() => {
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:581:8
|
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L601
2) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
948 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts-snapshots/running-layout-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation-retry1/running-layout-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation-retry1/running-layout-diff.png
599 | })
600 | )
> 601 | .toMatchSnapshot('running_layout.png');
| ^
602 |
603 | await page.click('jp-button[data-command="running:show-modal"]');
604 | await freeezeKernelIds();
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:601:8
|
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L581
2) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('.jp-RunningSessions-item.jp-mod-kernel')
Expected: 2
Received: 4
Call log:
- expect.soft.toHaveCount with timeout 5000ms
- waiting for locator('.jp-RunningSessions-item.jp-mod-kernel')
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
579 | await expect
580 | .soft(page.locator('.jp-RunningSessions-item.jp-mod-kernel'))
> 581 | .toHaveCount(2, { timeout: 5000 });
| ^
582 |
583 | const freeezeKernelIds = async () => {
584 | return page.evaluate(() => {
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:581:8
|
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L601
2) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
948 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts-snapshots/running-layout-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation-retry2/running-layout-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation-retry2/running-layout-diff.png
599 | })
600 | )
> 601 | .toMatchSnapshot('running_layout.png');
| ^
602 |
603 | await page.click('jp-button[data-command="running:show-modal"]');
604 | await freeezeKernelIds();
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:601:8
|
[documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu:
core/galata/test/documentation/workspaces.test.ts#L27
3) [documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu
Test timeout of 90000ms exceeded while running "beforeEach" hook.
25 | });
26 |
> 27 | test.beforeEach(async ({ page, tmpPath }) => {
| ^
28 | await page.filebrowser.openDirectory(tmpPath);
29 | });
30 |
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/workspaces.test.ts:27:8
|
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script):
galata/test/jupyterlab/debugger.test.ts#L1
1) [jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script)
Test timeout of 60000ms exceeded.
|
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script):
galata/src/helpers/activity.ts#L158
1) [jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script)
Error: locator.getAttribute: Target page, context or browser has been closed
at src/helpers/activity.ts:158
156 | locator = this.page.getByRole('main').getByRole('tabpanel', { name });
157 | } else {
> 158 | const id = await this.getTabLocator().getAttribute('data-id');
| ^
159 | if (!id) {
160 | return null;
161 | }
at ActivityHelper.getPanelLocator (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/activity.ts:158:45)
at NotebookHelper.getToolbarLocator (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/notebook.ts:150:28)
at DebuggerHelper.isOn (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/debuggerpanel.ts:27:41)
at fn (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/debuggerpanel.ts:55:51)
at Timeout.check (/home/runner/work/jupyterlab/jupyterlab/galata/src/utils.ts:183:33)
|
[jupyterlab] › test/jupyterlab/notebook-markdown.test.ts:86:7 › Notebook Markdown › Render a MermaidJS flowchart:
galata/test/jupyterlab/notebook-markdown.test.ts#L1
2) [jupyterlab] › test/jupyterlab/notebook-markdown.test.ts:86:7 › Notebook Markdown › Render a MermaidJS flowchart
Test timeout of 60000ms exceeded.
|
[jupyterlab] › test/jupyterlab/notebook-markdown.test.ts:86:7 › Notebook Markdown › Render a MermaidJS flowchart:
galata/test/jupyterlab/notebook-markdown.test.ts#L89
2) [jupyterlab] › test/jupyterlab/notebook-markdown.test.ts:86:7 › Notebook Markdown › Render a MermaidJS flowchart
Error: locator.screenshot: Test timeout of 60000ms exceeded.
Call log:
- waiting for getByRole('main').locator('[role="tabpanel"][id="id-8ca445d5-35a0-4758-ac00-469158db7c5b"]').locator('.jp-NotebookPanel-notebook').first().locator('.jp-Cell[data-windowed-list-index="3"]')
87 | const imageName = 'render-mermaid-flowchart.png';
88 | const cell = await page.notebook.getCellLocator(3);
> 89 | expect(await cell!.screenshot()).toMatchSnapshot(imageName);
| ^
90 | });
91 |
92 | test('Render a MermaidJS error', async ({ page, tmpPath }) => {
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/notebook-markdown.test.ts:89:24
|
[jupyterlab] › test/jupyterlab/notebook-max-outputs.test.ts:37:5 › Don't limit cell outputs if input is requested:
galata/test/jupyterlab/notebook-max-outputs.test.ts#L52
3) [jupyterlab] › test/jupyterlab/notebook-max-outputs.test.ts:37:5 › Don't limit cell outputs if input is requested
Error: expect(received).toBeGreaterThan(expected)
Expected: > 5
Received: 5
50 | await page.menu.clickMenuItem('Run>Run All Cells');
51 | await page.locator('.jp-Stdin >> text=Your age:').waitFor();
> 52 | expect(await page.locator('.jp-RenderedMarkdown').count()).toBeGreaterThan(
| ^
53 | MAX_OUTPUTS
54 | );
55 |
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/notebook-max-outputs.test.ts:52:62
|
[jupyterlab] › test/jupyterlab/notebook-scroll-no-windowing.test.ts:181:7 › Notebook scroll on execution (no windowing) › should scroll when advancing if top is only marginally visible:
galata/test/jupyterlab/notebook-scroll-no-windowing.test.ts#L203
4) [jupyterlab] › test/jupyterlab/notebook-scroll-no-windowing.test.ts:181:7 › Notebook scroll on execution (no windowing) › should scroll when advancing if top is only marginally visible
Error: Timed out 5000ms waiting for expect(locator).toBeInViewport()
Locator: getByRole('main').locator('[role="tabpanel"][id="id-cee9eddd-8e95-41ad-9143-5b0e57ed3c75"]').locator('.jp-NotebookPanel-notebook').first().locator('.jp-Cell[data-windowed-list-index="2"]')
Expected: in viewport
Received: outside viewport
Call log:
- expect.toBeInViewport with timeout 5000ms
- waiting for getByRole('main').locator('[role="tabpanel"][id="id-cee9eddd-8e95-41ad-9143-5b0e57ed3c75"]').locator('.jp-NotebookPanel-notebook').first().locator('.jp-Cell[data-windowed-list-index="2"]')
- locator resolved to <div tabindex="0" data-windowed-list-index="2" aria-l…>…</div>
- unexpected value "viewport ratio 0.009747706353664398"
- locator resolved to <div tabindex="0" data-windowed-list-index="2" aria-l…>…</div>
- unexpected value "viewport ratio 0.009747706353664398"
- locator resolved to <div tabindex="0" data-windowed-list-index="2" aria-l…>…</div>
- unexpected value "viewport ratio 0.009747706353664398"
- locator resolved to <div tabindex="0" data-windowed-list-index="2" aria-l…>…</div>
- unexpected value "viewport ratio 0.009747706353664398"
- locator resolved to <div tabindex="0" data-windowed-list-index="2" aria-l…>…</div>
- unexpected value "viewport ratio 0.009747706353664398"
- locator resolved to <div tabindex="0" data-windowed-list-index="2" aria-l…>…</div>
- unexpected value "viewport ratio 0.009747706353664398"
- locator resolved to <div tabindex="0" data-windowed-list-index="2" aria-l…>…</div>
- unexpected value "viewport ratio 0.009747706353664398"
- locator resolved to <div tabindex="0" data-windowed-list-index="2" aria-l…>…</div>
- unexpected value "viewport ratio 0.009747706353664398"
- locator resolved to <div tabindex="0" data-windowed-list-index="2" aria-l…>…</div>
- unexpected value "viewport ratio 0.009747706353664398"
201 |
202 | // After running the second cell, the third cell should be revealed, in at least 10%
> 203 | await expect(thirdCell!).toBeInViewport({ ratio: 0.1 });
| ^
204 |
205 | // The third cell should now occupy about half of the notebook viewport
206 | expect(await notebookViewportRatio(notebook!, thirdCell!)).toBeGreaterThan(
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/notebook-scroll-no-windowing.test.ts:203:30
|
🎭 Playwright Run Summary
3 failed
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ──────────────────
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ───
[documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu
60 passed (8.4m)
|
🎭 Playwright Run Summary
4 flaky
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script)
[jupyterlab] › test/jupyterlab/notebook-markdown.test.ts:86:7 › Notebook Markdown › Render a MermaidJS flowchart
[jupyterlab] › test/jupyterlab/notebook-max-outputs.test.ts:37:5 › Don't limit cell outputs if input is requested
[jupyterlab] › test/jupyterlab/notebook-scroll-no-windowing.test.ts:181:7 › Notebook scroll on execution (no windowing) › should scroll when advancing if top is only marginally visible
475 passed (32.5m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
jupyterlab-documentation-report
Expired
|
17.3 MB |
|
jupyterlab-documentation-test-assets
Expired
|
17.1 MB |
|
jupyterlab-galata-report
Expired
|
5.85 MB |
|
jupyterlab-galata-test-assets
Expired
|
210 Bytes |
|