Re-enable session lifespan, idle timeout api integration tests and use unique names for the security test reports.

[azasypkin]

Re-enable session lifespan api integration tests.

In this PR I also updated report names for some of our tests (made them unique) as it seems CI's Test Results only picks up tests from the first config with a specific report name. Trying to figure that out with Operations Team, not sure if it's just CI UI glitch or these tests aren't run at all.

Fixes: #76223, #76239

[azasypkin]

Flaky Test Runner Job (42 executions): https://kibana-ci.elastic.co/job/kibana+flaky-test-suite-runner/834/

[azasypkin]

Result from https://kibana-ci.elastic.co/job/kibana+flaky-test-suite-runner/834/: 42 runs, 0 failures.

[elasticmachine]

Pinging @elastic/kibana-security (Team:Security)

[jportner]

LGTM! 🎉

[kibanamachine]

💛 Build succeeded, but was flaky

• continuous-integration/kibana-ci/pull-request
• Commit: f60ba7d
• Flaky suites:
  • xpack-kibana-ciGroup1

---

Test Failures

X-Pack APM API integration tests (basic).x-pack/test/apm_api_integration/basic/tests/metrics_charts/metrics_charts·ts.APM specs (basic) Metrics when data is loaded for opbeans-node returns metrics data CPU usage has correct series overall values

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:00:00]         └-: APM specs (basic)
[00:00:00]           └-> "before all" hook
[00:02:09]           └-: Metrics
[00:02:09]             └-> "before all" hook
[00:02:09]             └-: when data is loaded
[00:02:09]               └-> "before all" hook
[00:02:09]               └-> "before all" hook
[00:02:10]                 │ info [metrics_8.0.0] Loading "mappings.json"
[00:02:10]                 │ info [metrics_8.0.0] Loading "data.json.gz"
[00:02:10]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1600412581729425782] [apm-8.0.0-metric-000001] creating index, cause [api], templates [], shards [1]/[0]
[00:02:10]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1600412581729425782] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[apm-8.0.0-metric-000001][0]]])." previous.health="YELLOW" reason="shards started [[apm-8.0.0-metric-000001][0]]"
[00:02:10]                 │ info [metrics_8.0.0] Created index "apm-8.0.0-metric-000001"
[00:02:10]                 │ debg [metrics_8.0.0] "apm-8.0.0-metric-000001" settings {"index":{"codec":"best_compression","lifecycle":{"name":"apm-rollover-30-days","rollover_alias":"apm-8.0.0-metric"},"mapping":{"total_fields":{"limit":"2000"}},"max_docvalue_fields_search":"200","number_of_replicas":"0","number_of_shards":"1","priority":"100","refresh_interval":"1ms"}}
[00:02:11]                 │ info [metrics_8.0.0] Indexed 2323 docs into "apm-8.0.0-metric-000001"
[00:02:11]               └-: for opbeans-node
[00:02:11]                 └-> "before all" hook
[00:02:11]                 └-: returns metrics data
[00:02:11]                   └-> "before all" hook
[00:02:11]                   └-> "before all" hook
[00:02:11]                   └-> contains CPU usage and System memory usage chart data
[00:02:11]                     └-> "before each" hook: global before each
[00:02:11]                     └-> "before each" hook
[00:02:11]                     └- ✓ pass  (1ms) "APM specs (basic) Metrics when data is loaded for opbeans-node returns metrics data contains CPU usage and System memory usage chart data"
[00:02:11]                   └-> "after each" hook
[00:02:11]                   └-: CPU usage
[00:02:11]                     └-> "before all" hook
[00:02:11]                     └-> "before all" hook
[00:02:11]                     └-> has correct series
[00:02:11]                       └-> "before each" hook: global before each
[00:02:11]                       └-> "before each" hook
[00:02:11]                       └- ✓ pass  (1ms) "APM specs (basic) Metrics when data is loaded for opbeans-node returns metrics data CPU usage has correct series"
[00:02:11]                     └-> "after each" hook
[00:02:11]                     └-> has correct series overall values
[00:02:11]                       └-> "before each" hook: global before each
[00:02:11]                       └-> "before each" hook
[00:02:11]                       └- ✖ fail: APM specs (basic) Metrics when data is loaded for opbeans-node returns metrics data CPU usage has correct series overall values
[00:02:11]                       │       Error: expect(received).toMatchInlineSnapshot(snapshot)
[00:02:11]                       │ 
[00:02:11]                       │ Snapshot name: `when data is loaded for opbeans-node returns metrics data CPU usage has correct series overall values 1`
[00:02:11]                       │ 
[00:02:11]                       │ - Snapshot  - 1
[00:02:11]                       │ + Received  + 1
[00:02:11]                       │ 
[00:02:11]                       │   Array [
[00:02:11]                       │     0.714,
[00:02:11]                       │ -   0.38770000000000004,
[00:02:11]                       │ +   0.3877,
[00:02:11]                       │     0.75,
[00:02:11]                       │     0.2543,
[00:02:11]                       │   ]
[00:02:11]                       │       + expected - actual
[00:02:11]                       │ 
[00:02:11]                       │       -false
[00:02:11]                       │       +true
[00:02:11]                       │       
[00:02:11]                       │       at Assertion.assert (/dev/shm/workspace/parallel/22/kibana/packages/kbn-expect/expect.js:100:11)
[00:02:11]                       │       at Assertion.toMatchInline [as eql] (/dev/shm/workspace/parallel/22/kibana/packages/kbn-expect/expect.js:244:8)
[00:02:11]                       │       at Context.apply (test/apm_api_integration/basic/tests/metrics_charts/metrics_charts.ts:69:16)
[00:02:11]                       │       at Object.apply (/dev/shm/workspace/parallel/22/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:84:30)
[00:02:11]                       │ 
[00:02:11]                       │ 

Stack Trace

{ Error: expect(received).toMatchInlineSnapshot(snapshot)

Snapshot name: `when data is loaded for opbeans-node returns metrics data CPU usage has correct series overall values 1`

- Snapshot  - 1
+ Received  + 1

  Array [
    0.714,
-   0.38770000000000004,
+   0.3877,
    0.75,
    0.2543,
  ]
    at Assertion.assert (/dev/shm/workspace/parallel/22/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.toMatchInline [as eql] (/dev/shm/workspace/parallel/22/kibana/packages/kbn-expect/expect.js:244:8)
    at Context.apply (test/apm_api_integration/basic/tests/metrics_charts/metrics_charts.ts:69:16)
    at Object.apply (/dev/shm/workspace/parallel/22/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:84:30) actual: 'false', expected: 'true', showDiff: true }

---

Build metrics

✅ unchanged

History

• 💚 Build #75203 succeeded 1db41a5
• 💚 Build #75145 succeeded 5a8622b

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[azasypkin]

7.x/7.10.0: 31cb622