Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix broken x-pack/filebeat tests #18149

Merged
merged 1 commit into from
May 1, 2020
Merged

Fix broken x-pack/filebeat tests #18149

merged 1 commit into from
May 1, 2020

Conversation

andrewkroh
Copy link
Member

What does this PR do?

The tests are failing due to the change in #16784. The fields key is referenced in
system tests so it needs to be present. This adds the key back.

Why is it important?

master is broken so no new work can be merged.

@andrewkroh
Fix broken x-pack/filebeat tests
e9467dd 
The tests are failing due to the change in elastic#16784. The `fields` key is referenced in
system tests so it needs to be present.
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label May 1, 2020
@andrewkroh andrewkroh requested a review from dedemorton May 1, 2020 20:56
@andrewkroh andrewkroh added the Team:Integrations Label for the Integrations team label May 1, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations (Team:Integrations)

@elasticmachine
Copy link
Collaborator

💔 Build Failed

Pipeline View Test View Changes Artifacts preview stats

Expand to view the summary

Build stats

Test stats 🧪

Test Results
Failed 1
Passed 509
Skipped 7
Total 517

Test errors

Expand to view the tests failures

  • Name: runTest – nose.failure.Failure

    • Status: FAILED
    • Age: 1
    • Duration: 0
    • Error Details: Cannot subscript an existing Union. Use Union[u, t] instead.

Steps errors

Expand to view the steps failures

  • Name: Mage update build test

    • Description: mage update build test

    • Result: FAILURE

    • Duration: 6 min 2 sec<

    • Start Time: 2020-05-01T21:21:49.371+0000

Log output

Expand to view the last 100 lines of log output 

[2020-05-01T21:27:50.956Z]     addr.filename, addr.module)
[2020-05-01T21:27:50.956Z]   File "/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/python-env/build/ve/linux/lib/python3.5/site-packages/nose/importer.py", line 47, in importFromPath
[2020-05-01T21:27:50.956Z]     return self.importFromDir(dir_path, fqname)
[2020-05-01T21:27:50.956Z]   File "/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/python-env/build/ve/linux/lib/python3.5/site-packages/nose/importer.py", line 94, in importFromDir
[2020-05-01T21:27:50.956Z]     mod = load_module(part_fqname, fh, filename, desc)
[2020-05-01T21:27:50.956Z]   File "/usr/lib/python3.5/imp.py", line 234, in load_module
[2020-05-01T21:27:50.957Z]     return load_source(name, filename, file)
[2020-05-01T21:27:50.957Z]   File "/usr/lib/python3.5/imp.py", line 172, in load_source
[2020-05-01T21:27:50.957Z]     module = _load(spec)
[2020-05-01T21:27:50.957Z]   File "<frozen importlib._bootstrap>", line 693, in _load
[2020-05-01T21:27:50.957Z]   File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
[2020-05-01T21:27:50.957Z]   File "<frozen importlib._bootstrap_external>", line 665, in exec_module
[2020-05-01T21:27:50.957Z]   File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
[2020-05-01T21:27:50.957Z]   File "/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/src/github.com/elastic/beats/x-pack/filebeat/tests/system/test_xpack_modules.py", line 6, in <module>
[2020-05-01T21:27:50.957Z]     import test_modules
[2020-05-01T21:27:50.957Z]   File "/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/src/github.com/elastic/beats/x-pack/filebeat/tests/system/../../../../filebeat/tests/system/test_modules.py", line 12, in <module>
[2020-05-01T21:27:50.957Z]     from deepdiff import DeepDiff
[2020-05-01T21:27:50.957Z]   File "/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/python-env/build/ve/linux/lib/python3.5/site-packages/deepdiff/__init__.py", line 10, in <module>
[2020-05-01T21:27:50.957Z]     from .diff import DeepDiff
[2020-05-01T21:27:50.957Z]   File "/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/python-env/build/ve/linux/lib/python3.5/site-packages/deepdiff/diff.py", line 17, in <module>
[2020-05-01T21:27:50.957Z]     from ordered_set import OrderedSet
[2020-05-01T21:27:50.957Z]   File "/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/python-env/build/ve/linux/lib/python3.5/site-packages/ordered_set.py", line 51, in <module>
[2020-05-01T21:27:50.957Z]     class OrderedSet(MutableSet[T], Sequence[T]):
[2020-05-01T21:27:50.957Z]   File "/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/python-env/build/ve/linux/lib/python3.5/site-packages/ordered_set.py", line 186, in OrderedSet
[2020-05-01T21:27:50.957Z]     def update(self, sequence: SetLike[T]) -> int:
[2020-05-01T21:27:50.957Z]   File "/usr/lib/python3.5/typing.py", line 546, in __getitem__
[2020-05-01T21:27:50.957Z]     "Cannot subscript an existing Union. Use Union[u, t] instead.")
[2020-05-01T21:27:50.957Z] TypeError: Cannot subscript an existing Union. Use Union[u, t] instead.
[2020-05-01T21:27:50.957Z] 
[2020-05-01T21:27:50.957Z] [error] 100.00% nose.failure.Failure.runTest: 0.0034s
[2020-05-01T21:27:50.957Z] ----------------------------------------------------------------------
[2020-05-01T21:27:50.957Z] Ran 1 test in 0.004s
[2020-05-01T21:27:50.957Z] 
[2020-05-01T21:27:50.957Z] FAILED (errors=1)
[2020-05-01T21:27:50.957Z] >> python test: Unit Testing Complete
[2020-05-01T21:27:50.957Z] Error: running "/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/python-env/build/ve/linux/bin/nosetests --process-timeout=90 --with-timer --with-xunit --xunit-file=build/TEST-python-unit.xml tests/system/test_xpack_modules.py" failed with exit code 1
[2020-05-01T21:27:51.103Z] Recording test results
[2020-05-01T21:27:54.019Z] Stashed 2 file(s)
[2020-05-01T21:27:54.039Z] Archiving artifacts
[2020-05-01T21:27:55.031Z] + curl -sSLo codecov https://codecov.io/bash
[2020-05-01T21:27:55.292Z] + FILE=auditbeat/build/coverage/full.cov
[2020-05-01T21:27:55.292Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-05-01T21:27:55.292Z] + FILE=filebeat/build/coverage/full.cov
[2020-05-01T21:27:55.292Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-05-01T21:27:55.292Z] + FILE=heartbeat/build/coverage/full.cov
[2020-05-01T21:27:55.292Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-05-01T21:27:55.292Z] + FILE=libbeat/build/coverage/full.cov
[2020-05-01T21:27:55.292Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-05-01T21:27:55.292Z] + FILE=metricbeat/build/coverage/full.cov
[2020-05-01T21:27:55.292Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-05-01T21:27:55.292Z] + FILE=packetbeat/build/coverage/full.cov
[2020-05-01T21:27:55.292Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-05-01T21:27:55.292Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-05-01T21:27:55.292Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-05-01T21:27:55.292Z] + FILE=journalbeat/build/coverage/full.cov
[2020-05-01T21:27:55.292Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-05-01T21:27:56.871Z] Failed in branch Filebeat x-pack
[2020-05-01T21:27:57.959Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/src/github.com/elastic/beats
[2020-05-01T21:27:58.288Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-05-01T21:27:58.313Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/src/github.com/elastic/beats/Lint
[2020-05-01T21:27:58.451Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/src/github.com/elastic/beats/Filebeat-x-pack
[2020-05-01T21:27:58.889Z] + cat
[2020-05-01T21:27:58.889Z] + /usr/local/bin/runbld ./runbld-script
[2020-05-01T21:27:58.889Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-05-01T21:28:05.488Z] runbld>>> runbld started
[2020-05-01T21:28:05.488Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-05-01T21:28:06.872Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-18149' in order of occurrence in the config (last value wins).
[2020-05-01T21:28:08.258Z] runbld>>> Debug logging enabled.
[2020-05-01T21:28:08.258Z] runbld>>> Storing result
[2020-05-01T21:28:08.258Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-05-01T21:28:08.258Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200501212808-E67C4C67
[2020-05-01T21:28:08.547Z] runbld>>> Adding system facts.
[2020-05-01T21:28:09.512Z] runbld>>> Adding vcs info for the latest commit:  e9467ddbea70e422ae4366e55efabc85a92ea871
[2020-05-01T21:28:09.773Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-05-01T21:28:09.773Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-05-01T21:28:09.773Z] Processing JUnit reports with runbld...
[2020-05-01T21:28:09.773Z] + echo 'Processing JUnit reports with runbld...'
[2020-05-01T21:28:10.035Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-05-01T21:28:10.035Z] runbld>>> DURATION: 17ms
[2020-05-01T21:28:10.035Z] runbld>>> STDOUT: 40 bytes
[2020-05-01T21:28:10.035Z] runbld>>> STDERR: 49 bytes
[2020-05-01T21:28:10.035Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-05-01T21:28:10.035Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/src/github.com/elastic/beats
[2020-05-01T21:28:11.423Z] runbld>>> Storing build metadata: 
[2020-05-01T21:28:11.423Z] runbld>>> Adding test report.
[2020-05-01T21:28:11.423Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149/src/github.com/elastic/beats
[2020-05-01T21:28:12.366Z] runbld>>> Found 2 test output files
[2020-05-01T21:28:12.938Z] runbld>>> Test output logs contained: Errors: 1 Failures: 0 Tests: 517 Skipped: 0
[2020-05-01T21:28:12.938Z] runbld>>> Storing result
[2020-05-01T21:28:12.938Z] runbld>>> FAILURES: 1
[2020-05-01T21:28:13.508Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-05-01T21:28:13.508Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200501212808-E67C4C67
[2020-05-01T21:28:13.508Z] runbld>>> Email notification disabled by environment variable.
[2020-05-01T21:28:13.508Z] runbld>>> Slack notification disabled by environment variable.
[2020-05-01T21:28:19.585Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18149
[2020-05-01T21:28:19.900Z] [INFO] getVaultSecret: Getting secrets
[2020-05-01T21:28:19.964Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-05-01T21:28:20.973Z] + chmod 755 generate-build-data.sh
[2020-05-01T21:28:20.973Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18149/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18149/runs/1 FAILURE 1925538
[2020-05-01T21:28:21.224Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18149/runs/1/steps/?limit=10000 -o steps-info.json

@andrewkroh
Copy link
Member Author

This fixes the build for Travis CI. There's a separate problem with the Jenkins worker python setup. I've opened #18150 for that issue.

@andrewkroh andrewkroh merged commit 3024b66 into elastic:master May 1, 2020
@andresrc andresrc removed the needs_team Indicates that the issue/PR needs a Team:* label label May 2, 2020
andrewkroh added a commit to andrewkroh/beats that referenced this pull request May 4, 2020
@andrewkroh
Fix broken x-pack/filebeat tests (elastic#18149)
047328b 
The tests are failing due to the change in elastic#16784. The `fields` key is referenced in
system tests so it needs to be present.

(cherry picked from commit 3024b66)
@andrewkroh andrewkroh mentioned this pull request May 4, 2020
Merged
andrewkroh added a commit to andrewkroh/beats that referenced this pull request May 4, 2020
@andrewkroh
Fix broken x-pack/filebeat tests (elastic#18149)
c9b9f0a 
The tests are failing due to the change in elastic#16784. The `fields` key is referenced in
system tests so it needs to be present.

(cherry picked from commit 3024b66)
@andrewkroh andrewkroh mentioned this pull request May 4, 2020
Merged
andrewkroh added a commit that referenced this pull request May 5, 2020
@andrewkroh
Fix broken x-pack/filebeat tests (#18149) (#18210)
fc49b2f 
The tests are failing due to the change in #16784. The `fields` key is referenced in
system tests so it needs to be present.

(cherry picked from commit 3024b66)
andrewkroh added a commit that referenced this pull request May 12, 2020
@andrewkroh
Fix broken x-pack/filebeat tests (#18149) (#18211)
ecb2260 
The tests are failing due to the change in #16784. The `fields` key is referenced in
system tests so it needs to be present.

(cherry picked from commit 3024b66)
leweafan pushed a commit to leweafan/beats that referenced this pull request Apr 28, 2023
@andrewkroh
Fix broken x-pack/filebeat tests (elastic#18149) (elastic#18211)
2cf3098 
The tests are failing due to the change in elastic#16784. The `fields` key is referenced in
system tests so it needs to be present.

(cherry picked from commit c7eff6c)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dedemorton dedemorton Awaiting requested review from dedemorton

Assignees
No one assigned
Labels
bug docs Filebeat Filebeat review Team:Integrations Label for the Integrations team v7.7.0 v7.8.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@andrewkroh @elasticmachine @andresrc