[Metricbeat] Fix googlecloud dashboards #18980

kaiyan-sheng · 2020-06-04T17:08:53Z

What does this PR do?

This PR is to fix googlecloud dashboard compute and pubsub. This is caused by changing metric names with suffix .value.
For example, uptime metric name changed from googlecloud.compute.instance.uptime.value to googlecloud.compute.instance.uptime.value.

Related issues

Closes [Metricbeat] GoogleCloud Dashboards using wrong fields #18962

Screenshots

elasticmachine · 2020-06-04T17:18:18Z

Pinging @elastic/integrations-platforms (Team:Platforms)

elasticmachine · 2020-06-04T18:03:00Z

💔 Build Failed

Expand to view the summary

Build stats

Build Cause: [Pull request #18980 updated]
Start Time: 2020-06-04T17:13:16.431+0000
Duration: 74 min 31 sec

Test stats 🧪

Test	Results
Failed	0
Passed	1001
Skipped	175
Total	1176

Steps errors

Expand to view the steps failures

Name: General Build Step
- Description: [2020-06-04T17:36:51.457Z] [Google Cloud Storage Plugin] Found 1 files to download from pattern: gs:
- Duration: 0 min 5 sec
- Start Time: 2020-06-04T17:36:51.386+0000
- log

Log output

Expand to view the last 100 lines of log output

[2020-06-04T18:23:14.912Z] + FILE=filebeat/build/coverage/full.cov
[2020-06-04T18:23:14.912Z] + '[' -f filebeat/build/coverage/full.cov ']'
[2020-06-04T18:23:14.912Z] + for i in auditbeat filebeat heartbeat libbeat metricbeat packetbeat winlogbeat journalbeat
[2020-06-04T18:23:14.912Z] + FILE=heartbeat/build/coverage/full.cov
[2020-06-04T18:23:14.912Z] + '[' -f heartbeat/build/coverage/full.cov ']'
[2020-06-04T18:23:14.912Z] + for i in auditbeat filebeat heartbeat libbeat metricbeat packetbeat winlogbeat journalbeat
[2020-06-04T18:23:14.912Z] + FILE=libbeat/build/coverage/full.cov
[2020-06-04T18:23:14.912Z] + '[' -f libbeat/build/coverage/full.cov ']'
[2020-06-04T18:23:14.912Z] + for i in auditbeat filebeat heartbeat libbeat metricbeat packetbeat winlogbeat journalbeat
[2020-06-04T18:23:14.912Z] + FILE=metricbeat/build/coverage/full.cov
[2020-06-04T18:23:14.912Z] + '[' -f metricbeat/build/coverage/full.cov ']'
[2020-06-04T18:23:14.912Z] + for i in auditbeat filebeat heartbeat libbeat metricbeat packetbeat winlogbeat journalbeat
[2020-06-04T18:23:14.912Z] + FILE=packetbeat/build/coverage/full.cov
[2020-06-04T18:23:14.912Z] + '[' -f packetbeat/build/coverage/full.cov ']'
[2020-06-04T18:23:14.912Z] + for i in auditbeat filebeat heartbeat libbeat metricbeat packetbeat winlogbeat journalbeat
[2020-06-04T18:23:14.912Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-06-04T18:23:14.912Z] + '[' -f winlogbeat/build/coverage/full.cov ']'
[2020-06-04T18:23:14.912Z] + for i in auditbeat filebeat heartbeat libbeat metricbeat packetbeat winlogbeat journalbeat
[2020-06-04T18:23:14.912Z] + FILE=journalbeat/build/coverage/full.cov
[2020-06-04T18:23:14.912Z] + '[' -f journalbeat/build/coverage/full.cov ']'
[2020-06-04T18:23:16.222Z] Post stage
[2020-06-04T18:23:16.230Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18980/src/github.com/elastic/beats
[2020-06-04T18:23:18.673Z] Starting "default"...
[2020-06-04T18:23:22.155Z] Machine "default" is already running.
[2020-06-04T18:23:27.707Z] Client:
[2020-06-04T18:23:27.707Z]  Version:      18.03.1-ce
[2020-06-04T18:23:27.707Z]  API version:  1.37
[2020-06-04T18:23:27.707Z]  Go version:   go1.9.5
[2020-06-04T18:23:27.707Z]  Git commit:   9ee9f40
[2020-06-04T18:23:27.707Z]  Built:        Thu Apr 26 07:13:02 2018
[2020-06-04T18:23:27.707Z]  OS/Arch:      darwin/amd64
[2020-06-04T18:23:27.707Z]  Experimental: false
[2020-06-04T18:23:27.707Z]  Orchestrator: swarm
[2020-06-04T18:23:27.707Z] 
[2020-06-04T18:23:27.707Z] Server: Docker Engine - Community
[2020-06-04T18:23:27.707Z]  Engine:
[2020-06-04T18:23:27.707Z]   Version:      19.03.5
[2020-06-04T18:23:27.707Z]   API version:  1.40 (minimum version 1.12)
[2020-06-04T18:23:27.707Z]   Go version:   go1.12.12
[2020-06-04T18:23:27.707Z]   Git commit:   633a0ea838
[2020-06-04T18:23:27.707Z]   Built:        Wed Nov 13 07:28:45 2019
[2020-06-04T18:23:27.707Z]   OS/Arch:      linux/amd64
[2020-06-04T18:23:27.707Z]   Experimental: false
[2020-06-04T18:23:27.707Z]  containerd:
[2020-06-04T18:23:27.707Z]   Version:     v1.2.10
[2020-06-04T18:23:27.707Z]   GitCommit:                  b34a5c8af56e510852c35414db4c1f4fa6172339
[2020-06-04T18:23:27.707Z]  runc:
[2020-06-04T18:23:27.707Z]   Version:     1.0.0-rc8+dev
[2020-06-04T18:23:27.707Z]   GitCommit:                  3e425f80a8c931f88e6d94a8c831b9d5aa481657
[2020-06-04T18:23:27.707Z]  docker-init:
[2020-06-04T18:23:27.707Z]   Version:     0.18.0
[2020-06-04T18:23:27.707Z]   GitCommit:                  fec3683
[2020-06-04T18:23:42.740Z] Killed
[2020-06-04T18:26:25.345Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18980/src/github.com/elastic/beats
[2020-06-04T18:26:25.701Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-06-04T18:26:25.712Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18980/src/github.com/elastic/beats/Lint
[2020-06-04T18:26:25.786Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18980/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-06-04T18:26:25.855Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18980/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-06-04T18:26:25.931Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18980/src/github.com/elastic/beats/Metricbeat-x-pack-Mac-OS-X
[2020-06-04T18:26:26.281Z] + cat
[2020-06-04T18:26:26.281Z] + /usr/local/bin/runbld ./runbld-script
[2020-06-04T18:26:26.281Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-06-04T18:26:32.877Z] runbld>>> runbld started
[2020-06-04T18:26:32.877Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-06-04T18:26:34.792Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-18980' in order of occurrence in the config (last value wins).
[2020-06-04T18:26:36.180Z] runbld>>> Debug logging enabled.
[2020-06-04T18:26:36.180Z] runbld>>> Storing result
[2020-06-04T18:26:36.180Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-06-04T18:26:36.180Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200604182635-7215C385
[2020-06-04T18:26:36.180Z] runbld>>> Adding system facts.
[2020-06-04T18:26:37.124Z] runbld>>> Adding vcs info for the latest commit:  930b730aec0d943b244e8734f3673ae62d6707e8
[2020-06-04T18:26:37.384Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-06-04T18:26:37.384Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-06-04T18:26:37.384Z] + echo 'Processing JUnit reports with runbld...'
[2020-06-04T18:26:37.384Z] Processing JUnit reports with runbld...
[2020-06-04T18:26:37.645Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-06-04T18:26:37.645Z] runbld>>> DURATION: 14ms
[2020-06-04T18:26:37.645Z] runbld>>> STDOUT: 40 bytes
[2020-06-04T18:26:37.645Z] runbld>>> STDERR: 49 bytes
[2020-06-04T18:26:37.645Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-06-04T18:26:37.645Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18980/src/github.com/elastic/beats
[2020-06-04T18:26:39.561Z] runbld>>> Storing build metadata: 
[2020-06-04T18:26:39.561Z] runbld>>> Adding test report.
[2020-06-04T18:26:39.561Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18980/src/github.com/elastic/beats
[2020-06-04T18:26:40.502Z] runbld>>> Found 8 test output files
[2020-06-04T18:26:40.762Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 1176 Skipped: 164
[2020-06-04T18:26:41.023Z] runbld>>> Storing result
[2020-06-04T18:26:41.023Z] runbld>>> FAILURES: 0
[2020-06-04T18:26:41.284Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-06-04T18:26:41.284Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200604182635-7215C385
[2020-06-04T18:26:41.284Z] runbld>>> Email notification disabled by environment variable.
[2020-06-04T18:26:41.284Z] runbld>>> Slack notification disabled by environment variable.
[2020-06-04T18:26:46.924Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18980
[2020-06-04T18:26:47.021Z] [INFO] getVaultSecret: Getting secrets
[2020-06-04T18:26:47.073Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-06-04T18:26:47.775Z] + chmod 755 generate-build-data.sh
[2020-06-04T18:26:47.775Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18980/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18980/runs/2 FAILURE 4411084
[2020-06-04T18:26:47.775Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18980/runs/2/steps/?limit=10000 -o steps-info.json
[2020-06-04T18:26:48.686Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18980/runs/2/tests/?status=FAILED -o tests-errors.json
[2020-06-04T18:26:48.686Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18980/runs/2/log/ -o pipeline-log.txt

(cherry picked from commit c825c72)

Co-authored-by: kaiyan-sheng <kaiyan.sheng@elastic.co>

Fix googlecloud dashboards

bfd1560

botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jun 4, 2020

kaiyan-sheng self-assigned this Jun 4, 2020

add changelog

930b730

kaiyan-sheng added needs_backport PR is waiting to be backported to other branches. review Team:Platforms Label for the Integrations - Platforms team labels Jun 4, 2020

botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jun 4, 2020

andresrc added [zube]: Inbox [zube]: In Review and removed [zube]: Inbox labels Jun 5, 2020

zube bot added [zube]: Inbox [zube]: In Review and removed [zube]: In Review [zube]: Inbox labels Jun 5, 2020

Merge remote-tracking branch 'upstream/master' into compute_dashboard

2142564

kaiyan-sheng requested a review from jsoriano June 5, 2020 18:28

jsoriano approved these changes Jun 8, 2020

View reviewed changes

andresrc added [zube]: In Review and removed [zube]: Inbox labels Jun 9, 2020

sayden merged commit c825c72 into elastic:master Jun 9, 2020

zube bot added [zube]: Done and removed [zube]: In Review labels Jun 9, 2020

sayden mentioned this pull request Jun 9, 2020

Cherry-pick #18980 to 7.x: [Metricbeat] Fix googlecloud dashboards #19066

Merged

sayden added v7.9.0 and removed needs_backport PR is waiting to be backported to other branches. labels Jun 9, 2020

sayden pushed a commit to sayden/beats that referenced this pull request Jun 9, 2020

[Metricbeat] Fix googlecloud dashboards (elastic#18980)

3f91ece

(cherry picked from commit c825c72)

sayden mentioned this pull request Jun 9, 2020

Cherry-pick #18980 to 7.8: [Metricbeat] Fix googlecloud dashboards #19067

Merged

sayden added the v7.8.0 label Jun 9, 2020

sayden pushed a commit to sayden/beats that referenced this pull request Jun 9, 2020

[Metricbeat] Fix googlecloud dashboards (elastic#18980)

1c2883a

(cherry picked from commit c825c72)

sayden added a commit that referenced this pull request Jun 9, 2020

[Metricbeat] Fix googlecloud dashboards (#18980) (#19067)

1ac85ce

Co-authored-by: kaiyan-sheng <kaiyan.sheng@elastic.co>

sayden added a commit that referenced this pull request Jun 9, 2020

[Metricbeat] Fix googlecloud dashboards (#18980) (#19066)

f221155

Co-authored-by: kaiyan-sheng <kaiyan.sheng@elastic.co>

kaiyan-sheng deleted the compute_dashboard branch June 12, 2020 12:25

andresrc removed the [zube]: Done label Jun 22, 2020

melchiormoulin pushed a commit to melchiormoulin/beats that referenced this pull request Oct 14, 2020

[Metricbeat] Fix googlecloud dashboards (elastic#18980)

a0b5da4

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Metricbeat] Fix googlecloud dashboards #18980

[Metricbeat] Fix googlecloud dashboards #18980

kaiyan-sheng commented Jun 4, 2020 •

edited

Loading

elasticmachine commented Jun 4, 2020

elasticmachine commented Jun 4, 2020 •

edited

Loading

Build stats

Test stats 🧪

[Metricbeat] Fix googlecloud dashboards #18980

[Metricbeat] Fix googlecloud dashboards #18980

Conversation

kaiyan-sheng commented Jun 4, 2020 • edited Loading

What does this PR do?

Related issues

Screenshots

elasticmachine commented Jun 4, 2020

elasticmachine commented Jun 4, 2020 • edited Loading

💔 Build Failed

Build stats

Test stats 🧪

Steps errors

Log output

kaiyan-sheng commented Jun 4, 2020 •

edited

Loading

elasticmachine commented Jun 4, 2020 •

edited

Loading