MWPW-169416 [MEP] stop treating remove action differently in preview #3619
run-nala-default.yml
on: pull_request
Matrix: Running Nala E2E UI Tests
Annotations
8 errors and 1 notice
Running Nala E2E UI Tests (20.x)
Process completed with exit code 1.
|
Running Nala E2E UI Tests (20.x):
nala/features/mas/benchmark/benchmark.test.js#L46
4) [milo-live-chromium] › features/mas/benchmark/benchmark.test.js:17:7 › Benchmark feature test suite › @MAS-CCD-benchmark,@MAS-CCD @merch-benchmark-ccd-cards @mas-benchmark @Commerce @smoke @regression @milo › step-2: Validate benchmark
Error: 2887.5999999999767ms should be less than limit 715.6097560976177ms (adjusted from 400ms)
expect(received).toBeTruthy()
Received: false
44 | expect(times.length).toBeGreaterThan(0);
45 | times.forEach((time) => {
> 46 | expect(parseFloat(time) < parseFloat(limit), `${time}ms should be less than limit ${limitMessage}`).toBeTruthy();
| ^
47 | });
48 | });
49 | });
at forEach (/home/runner/work/milo/milo/nala/features/mas/benchmark/benchmark.test.js:46:109)
at /home/runner/work/milo/milo/nala/features/mas/benchmark/benchmark.test.js:45:13
at /home/runner/work/milo/milo/nala/features/mas/benchmark/benchmark.test.js:27:5
|
Running Nala E2E UI Tests (20.x):
nala/features/personalization/mep-actions.test.js#L47
3) [milo-live-webkit] › features/personalization/mep-actions.test.js:23:5 › [Test Id - 1] confirm various page actions using mep,@mep @mepact1 @smoke @regression @milo
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible()
Locator: locator('.text').nth(8).locator('h3')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for locator('.text').nth(8).locator('h3')
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
45 | await expect(textBlock6.headlineAlt).toHaveText('Prepended to 4');
46 | await expect(textBlock7.headlineAlt).toHaveText('Base page text. Section 4');
> 47 | await expect(textBlock8.headlineAlt).not.toBeVisible();
| ^
48 | await expect(textBlock9.headlineAlt).toHaveText('Section 6 replacement');
49 | await expect(textBlock10.headlineAlt).toHaveText('Base page text. Section 7');
50 | await expect(textBlock11.headlineAlt).toHaveText('Replaced basepage fragment');
at /home/runner/work/milo/milo/nala/features/personalization/mep-actions.test.js:47:44
|
Running Nala E2E UI Tests (20.x):
nala/features/personalization/mep-actions.test.js#L47
3) [milo-live-webkit] › features/personalization/mep-actions.test.js:23:5 › [Test Id - 1] confirm various page actions using mep,@mep @mepact1 @smoke @regression @milo
Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible()
Locator: locator('.text').nth(8).locator('h3')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for locator('.text').nth(8).locator('h3')
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
45 | await expect(textBlock6.headlineAlt).toHaveText('Prepended to 4');
46 | await expect(textBlock7.headlineAlt).toHaveText('Base page text. Section 4');
> 47 | await expect(textBlock8.headlineAlt).not.toBeVisible();
| ^
48 | await expect(textBlock9.headlineAlt).toHaveText('Section 6 replacement');
49 | await expect(textBlock10.headlineAlt).toHaveText('Base page text. Section 7');
50 | await expect(textBlock11.headlineAlt).toHaveText('Replaced basepage fragment');
at /home/runner/work/milo/milo/nala/features/personalization/mep-actions.test.js:47:44
|
Running Nala E2E UI Tests (20.x):
nala/features/personalization/mep-actions.test.js#L47
2) [milo-live-firefox] › features/personalization/mep-actions.test.js:23:5 › [Test Id - 1] confirm various page actions using mep,@mep @mepact1 @smoke @regression @milo
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible()
Locator: locator('.text').nth(8).locator('h3')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for locator('.text').nth(8).locator('h3')
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
45 | await expect(textBlock6.headlineAlt).toHaveText('Prepended to 4');
46 | await expect(textBlock7.headlineAlt).toHaveText('Base page text. Section 4');
> 47 | await expect(textBlock8.headlineAlt).not.toBeVisible();
| ^
48 | await expect(textBlock9.headlineAlt).toHaveText('Section 6 replacement');
49 | await expect(textBlock10.headlineAlt).toHaveText('Base page text. Section 7');
50 | await expect(textBlock11.headlineAlt).toHaveText('Replaced basepage fragment');
at /home/runner/work/milo/milo/nala/features/personalization/mep-actions.test.js:47:44
|
Running Nala E2E UI Tests (20.x):
nala/features/personalization/mep-actions.test.js#L47
2) [milo-live-firefox] › features/personalization/mep-actions.test.js:23:5 › [Test Id - 1] confirm various page actions using mep,@mep @mepact1 @smoke @regression @milo
Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible()
Locator: locator('.text').nth(8).locator('h3')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for locator('.text').nth(8).locator('h3')
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
45 | await expect(textBlock6.headlineAlt).toHaveText('Prepended to 4');
46 | await expect(textBlock7.headlineAlt).toHaveText('Base page text. Section 4');
> 47 | await expect(textBlock8.headlineAlt).not.toBeVisible();
| ^
48 | await expect(textBlock9.headlineAlt).toHaveText('Section 6 replacement');
49 | await expect(textBlock10.headlineAlt).toHaveText('Base page text. Section 7');
50 | await expect(textBlock11.headlineAlt).toHaveText('Replaced basepage fragment');
at /home/runner/work/milo/milo/nala/features/personalization/mep-actions.test.js:47:44
|
Running Nala E2E UI Tests (20.x):
nala/features/personalization/mep-actions.test.js#L47
1) [milo-live-chromium] › features/personalization/mep-actions.test.js:23:5 › [Test Id - 1] confirm various page actions using mep,@mep @mepact1 @smoke @regression @milo
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible()
Locator: locator('.text').nth(8).locator('h3')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for locator('.text').nth(8).locator('h3')
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
45 | await expect(textBlock6.headlineAlt).toHaveText('Prepended to 4');
46 | await expect(textBlock7.headlineAlt).toHaveText('Base page text. Section 4');
> 47 | await expect(textBlock8.headlineAlt).not.toBeVisible();
| ^
48 | await expect(textBlock9.headlineAlt).toHaveText('Section 6 replacement');
49 | await expect(textBlock10.headlineAlt).toHaveText('Base page text. Section 7');
50 | await expect(textBlock11.headlineAlt).toHaveText('Replaced basepage fragment');
at /home/runner/work/milo/milo/nala/features/personalization/mep-actions.test.js:47:44
|
Running Nala E2E UI Tests (20.x):
nala/features/personalization/mep-actions.test.js#L47
1) [milo-live-chromium] › features/personalization/mep-actions.test.js:23:5 › [Test Id - 1] confirm various page actions using mep,@mep @mepact1 @smoke @regression @milo
Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible()
Locator: locator('.text').nth(8).locator('h3')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for locator('.text').nth(8).locator('h3')
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
- locator resolved to <h3 class="heading-l" id="section-6-replacement">…</h3>
- unexpected value "visible"
45 | await expect(textBlock6.headlineAlt).toHaveText('Prepended to 4');
46 | await expect(textBlock7.headlineAlt).toHaveText('Base page text. Section 4');
> 47 | await expect(textBlock8.headlineAlt).not.toBeVisible();
| ^
48 | await expect(textBlock9.headlineAlt).toHaveText('Section 6 replacement');
49 | await expect(textBlock10.headlineAlt).toHaveText('Base page text. Section 7');
50 | await expect(textBlock11.headlineAlt).toHaveText('Replaced basepage fragment');
at /home/runner/work/milo/milo/nala/features/personalization/mep-actions.test.js:47:44
|
Running Nala E2E UI Tests (20.x)
3 failed
[milo-live-chromium] › features/personalization/mep-actions.test.js:23:5 › [Test Id - 1] confirm various page actions using mep,@mep @mepact1 @smoke @regression @milo
[milo-live-firefox] › features/personalization/mep-actions.test.js:23:5 › [Test Id - 1] confirm various page actions using mep,@mep @mepact1 @smoke @regression @milo
[milo-live-webkit] › features/personalization/mep-actions.test.js:23:5 › [Test Id - 1] confirm various page actions using mep,@mep @mepact1 @smoke @regression @milo
1 flaky
[milo-live-chromium] › features/mas/benchmark/benchmark.test.js:17:7 › Benchmark feature test suite › @MAS-CCD-benchmark,@MAS-CCD @merch-benchmark-ccd-cards @mas-benchmark @Commerce @smoke @regression @milo
62 skipped
618 passed (8.7m)
|