Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Security Solution][Flaky] /x-pack/plugins/security_solution/cypress/e2e/inspect/inspect_button.cy.ts/Inspect Explore pages -- inspect Network page #153765

Closed
Tracked by #153667
MadameSheema opened this issue Mar 27, 2023 · 3 comments
Assignees
Labels
failed-test A test failure on a tracked branch, potentially flaky-test fixed Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:Threat Hunting Security Solution Threat Hunting Team technical debt Improvement of the software architecture and operational architecture test-failure-flaky

Comments

@MadameSheema
Copy link
Member

1) Inspect Explore pages
--
  | proc [cypress]        inspect Network page:
  | proc [cypress]      AssertionError: Timed out retrying after 150000ms: Expected to find element: `[data-test-subj="globalLoadingIndicator"]`, but never found it.
  | proc [cypress]       at waitForPageToBeLoaded (webpack:///./tasks/common.ts:200:28)
  | proc [cypress]       at Context.eval (webpack:///./e2e/inspect/inspect_button.cy.ts:50:27)

Inspect Explore pages -- inspect Network page (failed) (attempt 3)

@MadameSheema MadameSheema added test-failure-flaky Team:Threat Hunting Security Solution Threat Hunting Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. labels Mar 27, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-threat-hunting (Team:Threat Hunting)

@elasticmachine
Copy link
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@MadameSheema MadameSheema added triage_needed failed-test A test failure on a tracked branch, potentially flaky-test labels May 23, 2023
@stephmilovic stephmilovic added technical debt Improvement of the software architecture and operational architecture and removed triage_needed technical debt Improvement of the software architecture and operational architecture labels May 25, 2023
@angorayc angorayc self-assigned this May 26, 2023
@angorayc
Copy link
Contributor

angorayc commented May 26, 2023

Have a draft PR up, will let it run a few more times to make sure it's stable before merging.

angorayc added a commit that referenced this issue Jun 15, 2023
## Summary

#153765

Inspect button cypress was found flaky sometimes. I was able to
reproduce the scenario when the tests failed by setting network
throttling to slow 3G with Chrome.

Here's what I add to reduce the flakyness:
1. Taking `welcome icon` page into consideration when loading the page.
Check the welcome icon has shown and disappeared before checking the
loading indicator in the header. This should buy us more time to avoid
timeout in comparison to checking the loading indicator straight away.

<img width="2556" alt="Screenshot 2023-05-26 at 10 51 08"
src="https://github.com/elastic/kibana/assets/6295984/19f4b94f-e8e9-40ca-bb85-cc496a396bde">

2. ~Replace creating data view via api with loading esArchiver auditbeat
data. I assume preload the data could reduce the uncertainty of fetching
api under slow internet speed, and therefore reduce the possible failure
during setting up the tests.~
 
3. Update postDataView task:
#158543 (comment)

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
failed-test A test failure on a tracked branch, potentially flaky-test fixed Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:Threat Hunting Security Solution Threat Hunting Team technical debt Improvement of the software architecture and operational architecture test-failure-flaky
Projects
None yet
Development

No branches or pull requests

5 participants