Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Flaky Test]: TestStandaloneUpgradeRollbackOnRestarts – failed waiting for healthy agent and version (context deadline exceeded): could not unmarshal agent status output: unexpected end of JSON input #6733

Open
pchila opened this issue Feb 6, 2025 · 1 comment
Labels
flaky-test Unstable or unreliable test cases. Team:Elastic-Agent Label for the Agent team

Comments

@pchila
Copy link
Member

pchila commented Feb 6, 2025

Failing test case

TestStandaloneUpgradeRollbackOnRestarts

Error message

failed waiting for healthy agent and version (context deadline exceeded): could not unmarshal agent status output: unexpected end of JSON input

Build

https://buildkite.com/elastic/elastic-agent-extended-testing-bk/builds/1350#0194daae-65c2-4d84-83d3-99c13e0c7e13

OS

Windows

Stacktrace and notes

According to the watcher logs the upgrade is not rolled back as expected
In the diagnostics we only find 9.0.0-SNAPSHOT logs (the test performs 8.18.0-SNAPSHOT -> 9.0.0-SNAPSHOT upgrade, rolled back to 8.18.0-SNAPSHOT) so it seems that 8.18.0 has been cleaned up confirmed by this watcher log
  
  {"log.level":"info","@timestamp":"2025-02-06T10:21:27.713Z","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/application/upgrade.cleanup","file.name":"upgrade/rollback.go","file.line":132},"message":"Removing hashed data directory","file.path":"C:\\Program Files\\Elastic\\Agent\\data\\elastic-agent-8.18.0-SNAPSHOT-eb771e","ecs.version":"1.6.0"}
  
  The interesting bit is that the watcher stated that the grace period is passed after about a minute, during which there are some connection errors, HEALTHY and STOPPED states, but not enough to trigger a rollback.
@pchila pchila added flaky-test Unstable or unreliable test cases. Team:Elastic-Agent Label for the Agent team labels Feb 6, 2025
@elasticmachine
Copy link
Contributor

Pinging @elastic/elastic-agent (Team:Elastic-Agent)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
flaky-test Unstable or unreliable test cases. Team:Elastic-Agent Label for the Agent team
Projects
None yet
Development

No branches or pull requests

2 participants