[JJBB] for the update-beats #5690

v1v · 2021-07-13T12:29:20Z

Motivation/summary

First step to automate the update-beats proces.
For such, there will be a new Multibranch pipeline:

which runs on a daily basis for the master branch by default.
PRs won't be triggered by default, but in case of any changes in the scripts, this could be tested manually through the Jenkins UI.

Then, the pipeline with the automation will be created.

Related issues

#4941

…ration

apmmachine · 2021-07-13T13:10:51Z

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2021-07-13T12:29:33.788+0000
Duration: 41 min 10 sec
Commit: 3ef36c2

Test stats 🧪

Test	Results
Failed	1
Passed	5880
Skipped	14
Total	5895

Trends 🧪

Test errors

Expand to view the tests failures

`Build and Test / APM Integration Tests / test_concurrent_req_dotnet – tests.agent.test_dotnet`

Expand to view the error details

 AssertionError: queried for [('processor.event', 'span'), ('service.name', ['dotnetapp'])], expected 2000, got 1998

Expand to view the stacktrace

 dotnet = <tests.fixtures.agents.Agent object at 0x7f2a4978ff50>

    @pytest.mark.version
    @pytest.mark.dotnet
    def test_concurrent_req_dotnet(dotnet):
        foo = Concurrent.Endpoint(dotnet.foo.url,
                                  dotnet.app_name,
                                  ["foo"],
                                  "GET /foo")
>       Concurrent(dotnet.apm_server.elasticsearch, [foo], iters=2).run()

tests/agent/test_dotnet.py:28: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/agent/concurrent_requests.py:254: in run
    self.check_counts(it)
tests/agent/concurrent_requests.py:141: in check_counts
    assert_count([("processor.event", "span"), ('service.name', service_names)], spans_count)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

terms = [('processor.event', 'span'), ('service.name', ['dotnetapp'])]
expected = 2000

    def assert_count(terms, expected):
        """wait a bit for doc count to reach expectation"""
        @timeout_decorator.timeout(max_wait)
        def check_count(mut_actual):
            while True:
                rsp = self.es.count(index=self.index, body=self.elasticsearch.term_q(terms))
                mut_actual[0] = rsp["count"]
                if mut_actual[0] >= expected:
                    return
                time.sleep(backoff)
    
        mut_actual = [-1]  # keep actual count in this mutable
        try:
            check_count(mut_actual)
        except timeout_decorator.TimeoutError:
            pass
        actual = mut_actual[0]
>       assert actual == expected, err.format(terms, expected, actual)
E       AssertionError: queried for [('processor.event', 'span'), ('service.name', ['dotnetapp'])], expected 2000, got 1998

tests/agent/concurrent_requests.py:132: AssertionError

Steps errors

Expand to view the steps failures

`Test Sync`

Took 4 min 34 sec . View more details on here
Description: ./.ci/scripts/sync.sh

Log output

Expand to view the last 100 lines of log output

[2021-07-13T13:10:20.652Z] === RUN   TestBreakdownMetrics
[2021-07-13T13:10:20.652Z] --- PASS: TestBreakdownMetrics (4.18s)
[2021-07-13T13:10:20.652Z] === RUN   TestApplicationMetrics
[2021-07-13T13:10:20.652Z] --- PASS: TestApplicationMetrics (5.71s)
[2021-07-13T13:10:20.652Z] === RUN   TestAPMServerMonitoring
[2021-07-13T13:10:20.652Z] --- PASS: TestAPMServerMonitoring (0.72s)
[2021-07-13T13:10:20.652Z] === RUN   TestAPMServerMonitoringBuiltinUser
[2021-07-13T13:10:20.652Z] --- PASS: TestAPMServerMonitoringBuiltinUser (2.00s)
[2021-07-13T13:10:20.652Z] === RUN   TestAPMServerOnboarding
[2021-07-13T13:10:20.652Z] --- PASS: TestAPMServerOnboarding (5.71s)
[2021-07-13T13:10:20.652Z] === RUN   TestOTLPGRPCTraces
[2021-07-13T13:10:20.652Z] --- PASS: TestOTLPGRPCTraces (4.25s)
[2021-07-13T13:10:20.652Z] === RUN   TestOTLPGRPCMetrics
[2021-07-13T13:10:20.652Z] --- PASS: TestOTLPGRPCMetrics (6.17s)
[2021-07-13T13:10:20.652Z] === RUN   TestOTLPGRPCAuth
[2021-07-13T13:10:20.652Z] --- PASS: TestOTLPGRPCAuth (4.34s)
[2021-07-13T13:10:20.653Z] === RUN   TestOTLPClientIP
[2021-07-13T13:10:20.653Z] --- PASS: TestOTLPClientIP (5.63s)
[2021-07-13T13:10:20.653Z] === RUN   TestRUMXForwardedFor
[2021-07-13T13:10:20.653Z] --- PASS: TestRUMXForwardedFor (3.77s)
[2021-07-13T13:10:20.653Z] === RUN   TestRUMAllowServiceNames
[2021-07-13T13:10:20.653Z] --- PASS: TestRUMAllowServiceNames (0.21s)
[2021-07-13T13:10:20.653Z] === RUN   TestRUMRateLimit
[2021-07-13T13:10:20.653Z] --- PASS: TestRUMRateLimit (0.98s)
[2021-07-13T13:10:20.653Z] === RUN   TestRUMCORS
[2021-07-13T13:10:20.653Z] --- PASS: TestRUMCORS (0.17s)
[2021-07-13T13:10:20.653Z] === RUN   TestKeepUnsampled
[2021-07-13T13:10:20.653Z] === RUN   TestKeepUnsampled/false
[2021-07-13T13:10:20.653Z] === RUN   TestKeepUnsampled/true
[2021-07-13T13:10:20.653Z] --- PASS: TestKeepUnsampled (9.35s)
[2021-07-13T13:10:20.653Z]     --- PASS: TestKeepUnsampled/false (5.63s)
[2021-07-13T13:10:20.653Z]     --- PASS: TestKeepUnsampled/true (3.72s)
[2021-07-13T13:10:20.653Z] === RUN   TestKeepUnsampledWarning
[2021-07-13T13:10:20.653Z] --- PASS: TestKeepUnsampledWarning (5.21s)
[2021-07-13T13:10:20.653Z] === RUN   TestTailSampling
[2021-07-13T13:10:20.653Z]     sampling_test.go:135: waiting for 100 "parent" transactions
[2021-07-13T13:10:20.653Z]     sampling_test.go:135: waiting for 100 "child" transactions
[2021-07-13T13:10:20.653Z] --- PASS: TestTailSampling (6.52s)
[2021-07-13T13:10:20.653Z] === RUN   TestTailSamplingUnlicensed
[2021-07-13T13:10:20.653Z] 2021/07/13 13:09:13 Starting container id: 5fc5efe2ef93 image: docker.elastic.co/elasticsearch/elasticsearch:8.0.0-08d745df-SNAPSHOT
[2021-07-13T13:10:20.653Z] 2021/07/13 13:09:13 Waiting for container id 5fc5efe2ef93 image: docker.elastic.co/elasticsearch/elasticsearch:8.0.0-08d745df-SNAPSHOT
[2021-07-13T13:10:20.653Z] 2021/07/13 13:09:32 Container is ready id: 5fc5efe2ef93 image: docker.elastic.co/elasticsearch/elasticsearch:8.0.0-08d745df-SNAPSHOT
[2021-07-13T13:10:20.653Z] --- PASS: TestTailSamplingUnlicensed (30.41s)
[2021-07-13T13:10:20.653Z] === RUN   TestRUMErrorSourcemapping
[2021-07-13T13:10:20.653Z] --- PASS: TestRUMErrorSourcemapping (5.95s)
[2021-07-13T13:10:20.653Z] === RUN   TestRUMSpanSourcemapping
[2021-07-13T13:10:20.653Z] --- PASS: TestRUMSpanSourcemapping (4.45s)
[2021-07-13T13:10:20.653Z] === RUN   TestDuplicateSourcemapWarning
[2021-07-13T13:10:20.653Z] --- PASS: TestDuplicateSourcemapWarning (5.74s)
[2021-07-13T13:10:20.653Z] === RUN   TestNoMatchingSourcemap
[2021-07-13T13:10:20.653Z] --- PASS: TestNoMatchingSourcemap (4.39s)
[2021-07-13T13:10:20.653Z] === RUN   TestFetchLatestSourcemap
[2021-07-13T13:10:20.653Z] --- PASS: TestFetchLatestSourcemap (5.45s)
[2021-07-13T13:10:20.653Z] === RUN   TestSourcemapCaching
[2021-07-13T13:10:20.653Z] --- PASS: TestSourcemapCaching (5.85s)
[2021-07-13T13:10:20.653Z] === RUN   TestIndexTemplateCoverage
[2021-07-13T13:10:20.653Z] --- PASS: TestIndexTemplateCoverage (5.21s)
[2021-07-13T13:10:20.653Z] PASS
[2021-07-13T13:10:20.653Z] ok  	github.com/elastic/apm-server/systemtest	386.511s
[2021-07-13T13:10:20.653Z] === RUN   TestAPMServer
[2021-07-13T13:10:20.653Z] 2021/07/13 13:03:51 Building apm-server...
[2021-07-13T13:10:20.653Z] 2021/07/13 13:03:54 Built /var/lib/jenkins/workspace/pm-server_apm-server-mbp_PR-5690/src/github.com/elastic/apm-server/apm-server
[2021-07-13T13:10:20.653Z] --- PASS: TestAPMServer (2.51s)
[2021-07-13T13:10:20.653Z] === RUN   TestUnstartedAPMServer
[2021-07-13T13:10:20.653Z] --- PASS: TestUnstartedAPMServer (0.00s)
[2021-07-13T13:10:20.653Z] === RUN   TestAPMServerStartTLS
[2021-07-13T13:10:20.653Z] --- PASS: TestAPMServerStartTLS (0.11s)
[2021-07-13T13:10:20.653Z] === RUN   TestExpvar
[2021-07-13T13:10:20.653Z] --- PASS: TestExpvar (0.10s)
[2021-07-13T13:10:20.653Z] PASS
[2021-07-13T13:10:20.653Z] ok  	github.com/elastic/apm-server/systemtest/apmservertest	2.729s
[2021-07-13T13:10:20.653Z] ?   	github.com/elastic/apm-server/systemtest/benchtest	[no test files]
[2021-07-13T13:10:20.653Z] ?   	github.com/elastic/apm-server/systemtest/cmd/apmbench	[no test files]
[2021-07-13T13:10:20.653Z] ?   	github.com/elastic/apm-server/systemtest/estest	[no test files]
[2021-07-13T13:10:20.653Z] ?   	github.com/elastic/apm-server/systemtest/fleettest	[no test files]
[2021-07-13T13:10:20.653Z] + cleanup
[2021-07-13T13:10:20.653Z] + rm -rf /tmp/tmp.eyU2nyvhuu
[2021-07-13T13:10:20.653Z] + .ci/scripts/docker-get-logs.sh
[2021-07-13T13:10:22.040Z] It is not possible to grab the logs of ae2941b42225
[2021-07-13T13:10:23.767Z] Post stage
[2021-07-13T13:10:23.812Z] Running in /var/lib/jenkins/workspace/pm-server_apm-server-mbp_PR-5690/src/github.com/elastic/apm-server/build
[2021-07-13T13:10:23.902Z] Archiving artifacts
[2021-07-13T13:10:24.363Z] Recording test results
[2021-07-13T13:10:25.471Z] [Checks API] No suitable checks publisher found.
[2021-07-13T13:10:26.107Z] + tar --version
[2021-07-13T13:10:26.538Z] + tar --exclude=system-tests-linux-files.tgz -czf system-tests-linux-files.tgz system-tests
[2021-07-13T13:10:26.579Z] Archiving artifacts
[2021-07-13T13:10:27.262Z] Terminated
[2021-07-13T13:10:27.238Z] Terminated
[2021-07-13T13:10:37.168Z] [INFO] For detailed information see: https://apm-ci.elastic.co/job/apm-integration-tests-selector-mbp/job/master/18671/display/redirect
[2021-07-13T13:10:39.804Z] Copied 27 artifacts from "APM Integration Test MBP Selector » master" build number 18671
[2021-07-13T13:10:41.060Z] Post stage
[2021-07-13T13:10:41.082Z] Recording test results
[2021-07-13T13:10:41.719Z] [Checks API] No suitable checks publisher found.
[2021-07-13T13:10:42.664Z] Running on Jenkins in /var/lib/jenkins/workspace/pm-server_apm-server-mbp_PR-5690
[2021-07-13T13:10:42.799Z] [INFO] getVaultSecret: Getting secrets
[2021-07-13T13:10:42.868Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-07-13T13:10:43.961Z] + chmod 755 generate-build-data.sh
[2021-07-13T13:10:43.961Z] + ./generate-build-data.sh https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-server/apm-server-mbp/PR-5690/ https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-server/apm-server-mbp/PR-5690/runs/1 UNSTABLE 2469899
[2021-07-13T13:10:43.961Z] INFO: curl https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-server/apm-server-mbp/PR-5690/runs/1/steps/?limit=10000 -o steps-info.json

v1v · 2021-07-13T15:08:10Z

Merging PR since changes are not related to the source code but the CI jobs.

v1v · 2021-07-13T15:08:39Z

Backport is not required since this automation with JJB only works for the main branch

v1v added 2 commits July 13, 2021 13:23

[JJBB] for the update-beats

e621225

no scm triggering and delegate the responsability to the cron configu…

3ef36c2

…ration

v1v requested a review from a team July 13, 2021 12:29

v1v added automation Team:Automation Label for the Observability productivity team labels Jul 13, 2021

v1v self-assigned this Jul 13, 2021

v1v mentioned this pull request Jul 13, 2021

CI: automate update-beats #4941

Closed

v1v mentioned this pull request Jul 13, 2021

[CI] automate update-beats #5692

Merged

kuisathaverat approved these changes Jul 13, 2021

View reviewed changes

v1v merged commit 6d1427e into elastic:master Jul 13, 2021

v1v deleted the feature/jjbb-update-beats branch July 13, 2021 15:08

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[JJBB] for the update-beats #5690

[JJBB] for the update-beats #5690

v1v commented Jul 13, 2021 •

edited

Loading

apmmachine commented Jul 13, 2021

Build stats

Test stats 🧪

Trends 🧪

`Build and Test / APM Integration Tests / test_concurrent_req_dotnet – tests.agent.test_dotnet`

`Test Sync`

v1v commented Jul 13, 2021

v1v commented Jul 13, 2021

[JJBB] for the update-beats #5690

[JJBB] for the update-beats #5690

Conversation

v1v commented Jul 13, 2021 • edited Loading

Motivation/summary

Related issues

apmmachine commented Jul 13, 2021

💔 Tests Failed

Build stats

Test stats 🧪

Trends 🧪

Test errors

Build and Test / APM Integration Tests / test_concurrent_req_dotnet – tests.agent.test_dotnet

Steps errors

Test Sync

Log output

v1v commented Jul 13, 2021

v1v commented Jul 13, 2021

v1v commented Jul 13, 2021 •

edited

Loading

`Build and Test / APM Integration Tests / test_concurrent_req_dotnet – tests.agent.test_dotnet`

`Test Sync`