Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add failure analytics for OpenSearch #3713

Closed
dreamer-89 opened this issue Jun 27, 2022 · 1 comment
Closed

Add failure analytics for OpenSearch #3713

dreamer-89 opened this issue Jun 27, 2022 · 1 comment
Assignees
Labels
CI CI related enhancement Enhancement or improvement to existing feature or request

Comments

@dreamer-89
Copy link
Member

dreamer-89 commented Jun 27, 2022

Is your feature request related to a problem? Please describe.
Today, CI gradle check fails often due to existing flaky tests. Issues are created to track these failures (Meta issue). There is no existing mechanism to answer below questions:

  1. Identify top hitter for prioritization.
  2. Identify commit introduced a flaky test or increase freq of existing test failure.
  3. Build failure trend to identify health of software.
  4. Developers impacted due to flaky tests.
  5. Test history.

With growth of OpenSearch, it is not possible to continue to use manual approach to track flaky test issues. There should be a mechanism to identify top hitter (prioritise right flaky test), commit that introduced a new failure, service health in general, faster debugging etc.

Describe the solution you'd like
Enable failure analytics using gradle enterprise, which provides out of the box failure analytics and solves use cases in description and much more.

Describe alternatives you've considered

  1. Continue existing manual approach. This is not scalable.
  2. Use OpenSearch to store gradle logs or gradle scan data by calling gradle APIs.
@andrross
Copy link
Member

andrross commented Jun 1, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI CI related enhancement Enhancement or improvement to existing feature or request
Projects
None yet
Development

No branches or pull requests

4 participants