Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/ml/data_frame_analytics/classification_creation·ts - machine learning data frame analytics classification creation bank marketing edits the analytics job and displays it correctly in the job list #91450

Closed
kibanamachine opened this issue Feb 16, 2021 · 13 comments · Fixed by #91473 or #95797
Closed

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/ml/data_frame_analytics/classification_creation·ts - machine learning data frame analytics classification creation bank marketing edits the analytics job and displays it correctly in the job list #91450

kibanamachine opened this issue Feb 16, 2021 · 13 comments · Fixed by #91473 or #95797
Assignees
@pheyos
Labels
failed-test A test failure on a tracked branch, potentially flaky-test :ml

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Feb 16, 2021 •
edited
Loading

A test failed on a tracked branch

Error: Color stats for canvas element should be within tolerance. Expected: '[{"key":"#FFFFFF","value":93},{"key":"#98A2B3","value":1},{"key":"#DDDDDD","value":3},{"key":"#6092C0","value":1}]' (got '[{"key":"#FFFFFF","value":92,"withinTolerance":true},{"key":"#6092C0","value":1,"withinTolerance":true},{"key":"#DDDDDD","value":3,"withinTolerance":true},{"key":"#54B399","value":1,"withinTolerance":false}]')
    at Assertion.assert (/dev/shm/workspace/parallel/4/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.eql (/dev/shm/workspace/parallel/4/kibana/packages/kbn-expect/expect.js:244:8)
    at AnalyticsCanvasElement.assertCanvasElement (test/functional/services/ml/data_frame_analytics_canvas_element.ts:33:67)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:93:5)
    at Context.<anonymous> (test/functional/apps/ml/data_frame_analytics/classification_creation.ts:233:11)
    at Object.apply (/dev/shm/workspace/parallel/4/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16) {
  actual: 'false',
  expected: 'true',
  showDiff: true
}

First failure: Jenkins Build
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Feb 16, 2021
@pheyos pheyos self-assigned this Feb 16, 2021
@pheyos pheyos added the :ml label Feb 16, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui (:ml)

@pheyos
Copy link
Member

pheyos commented Feb 16, 2021 •
edited
Loading

This failing test is the ROC chart validation, that has been introduced in #89991, but it passed in other runs so far, so there's probably some flakiness. Looks like in addition to the three expected colors there's a fourth (unexpected) one:

{"key":"#54B399","value":1,"withinTolerance":false}

For additional context, this is the failure screenshot:
image

@walterra you know this new validation best, could you please take a look?

@walterra walterra mentioned this issue Feb 16, 2021
Merged
2 tasks
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@spong spong mentioned this issue Feb 16, 2021
Merged
1 task
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

tylersmalley added a commit that referenced this issue Feb 17, 2021
@tylersmalley
skip flaky suite (#91450)
042f352
tylersmalley added a commit that referenced this issue Feb 17, 2021
@tylersmalley
skip flaky suite (#91450)
61d0ae3
@tylersmalley
Copy link
Contributor

tylersmalley commented Feb 17, 2021 •
edited
Loading

Skipped

image

master: 042f352
7.x: 61d0ae3

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

gmmorris added a commit to gmmorris/kibana that referenced this issue Feb 17, 2021
@gmmorris
Merge branch 'master' into task-manager/docs-monitoring
61d7256 
* master: (157 commits)
  [DOCS] Adds machine learning to the security section of alerting (elastic#91501)
  [Uptime] Ping list step screenshot caption formatting (elastic#91403)
  [Vislib] Use timestamp on brush event instead of iso dates (elastic#91483)
  [Application Usage] Remove deprecated & unused legacy.appChanged API (elastic#91464)
  Migrate logstash, monitoring, url_drilldowns, xpack_legacy to ts projects (elastic#91194)
  [APM] Wrap Elasticsearch client errors (elastic#91125)
  [APM] Fix optimize-tsconfig script (elastic#91487)
  [Discover][docs] Add searchFieldsFromSource description (elastic#90980)
  Adds support for 'ip' data type (elastic#85087)
  [Detection Rules] Add updates from 7.11.2 rules (elastic#91553)
  [SECURITY SOLUTION] Eql in timeline (elastic#90816)
  [APM] Correlations Beta (elastic#86477) (elastic#89952)
  [Security Solutions][Detection Engine] Adds a warning banner when the alerts data has not been migrated yet. (elastic#90258)
  [Security Solution] [Timeline] Endpoint row renderers (2nd batch) (elastic#91446)
  skip flaky suite (elastic#91450)
  skip flaky suite (elastic#91592)
  [Security Solution][Endpoint][Admin] Endpoint Details UX Enhancements (elastic#90870)
  [ML] Add better UI support for runtime fields Transforms  (elastic#90363)
  [Security Solution] [Detections] Replace 'partial failure' with 'warning' for rule statuses (elastic#91167)
  [Security Solution][Detections] Adds Indicator path config for indicator match rules (elastic#91260)
  ...
@pheyos pheyos removed the ml label Feb 17, 2021
@kibanamachine kibanamachine reopened this Mar 25, 2021
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

mistic added a commit that referenced this issue Mar 29, 2021
@mistic
skip flaky suite (#91450)
a10e3d4
@mistic mistic added blocker and removed v7.12.0 labels Mar 29, 2021
mistic added a commit that referenced this issue Mar 29, 2021
@mistic
skip flaky suite (#91450)
7977d49
@mistic
Copy link
Member

mistic commented Mar 29, 2021

The test has been failing both on master and 7.x. Skipping for now as it looks flaky.

master/8.0: a10e3d4
7.x/7.13: 7977d49

@walterra walterra mentioned this issue Apr 1, 2021
Merged
2 tasks
@kibanamachine kibanamachine reopened this Sep 22, 2021
@kibanamachine
Copy link
Contributor Author

New failure: CI Build

@pheyos
Copy link
Member

pheyos commented Sep 22, 2021

This is a different failure now:
image

@pheyos
Copy link
Member

pheyos commented Nov 22, 2021

This failure didn't happen again in the last 2 months. Looks like it was only a one-off. Closing.

@pheyos pheyos closed this as completed Nov 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pheyos pheyos

Labels
failed-test A test failure on a tracked branch, potentially flaky-test :ml
Projects
None yet
Milestone
No milestone
6 participants
@tylersmalley @pheyos @mistic @peteharverson @elasticmachine @kibanamachine