Use verbose gather log #1745
Closed
Use verbose gather log #1745
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
nirs
commented
Jan 13, 2025
This logs very verbose gather logs in the console, to help debugging
issues in kubectl gather when running in the CI.
Example run with minimal minimal environment:
% drenv gather envs/vm.yaml -v
2025-01-14 01:14:41,352 DEBUG [envfile] Detected os: 'darwin'
2025-01-14 01:14:41,352 DEBUG [envfile] Detected machine: 'arm64'
2025-01-14 01:14:41,352 DEBUG [envfile] Using provider: 'lima'
2025-01-14 01:14:41,353 DEBUG [envfile] Using driver: ''
2025-01-14 01:14:41,353 DEBUG [envfile] Using network: ''
2025-01-14 01:14:41,353 INFO [vm] Gathering environment
2025-01-14 01:14:41,390 DEBUG [vm] 2025-01-14T01:14:41.389+0200 INFO gather Using kubeconfig "/Users/nir/.kube/config"
2025-01-14 01:14:41,390 DEBUG [vm] 2025-01-14T01:14:41.390+0200 INFO gather Gathering from all namespaces
2025-01-14 01:14:41,390 DEBUG [vm] 2025-01-14T01:14:41.390+0200 INFO gather Using all addons
2025-01-14 01:14:41,390 DEBUG [vm] 2025-01-14T01:14:41.390+0200 INFO gather Storing data in "gather.20250114011441"
2025-01-14 01:14:41,390 DEBUG [vm] 2025-01-14T01:14:41.390+0200 INFO gather Gathering from cluster "cluster"
2025-01-14 01:14:41,398 DEBUG [vm] 2025-01-14T01:14:41.398+0200 DEBUG gather.cluster Listed 49 api resources in 0.007 seconds
2025-01-14 01:14:41,400 DEBUG [vm] 2025-01-14T01:14:41.400+0200 DEBUG gather.cluster Listed 2 "endpoints" in 0.002 seconds
2025-01-14 01:14:41,401 DEBUG [vm] 2025-01-14T01:14:41.401+0200 DEBUG gather.cluster Listed 0 "persistentvolumeclaims" in 0.003 seconds
...
2025-01-14 01:14:41,453 DEBUG [vm] 2025-01-14T01:14:41.453+0200 INFO gather Gathered 321 resources from cluster "cluster" in 0.063 seconds
2025-01-14 01:14:41,453 DEBUG [vm] 2025-01-14T01:14:41.453+0200 INFO gather Gathered 321 resources from 1 clusters in 0.063 seconds
2025-01-14 01:14:41,460 INFO [vm] Environment gathered in 0.11 seconds
2025-01-14 01:14:41,460 DEBUG [main] Starting shutdown
2025-01-14 01:14:41,460 DEBUG [main] Terminating process group 47188
Issues:
- The logs include timestamps and log level from kubectl gather. We
really want to log only the message. We will improve it later by
adding --log-format=json option to kubectl gather like lima.
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
This may help to diagnose cases when kubectl gather get stuck: https://github.com/RamenDR/ramen/actions/runs/12712182155/job/35437188040 Signed-off-by: Nir Soffer <nsoffer@redhat.com>
|
Replaced by #1748. I don't think that verbose logs in the console is the right way, and with the current timeout we should always get the gather logs. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pass drenv --verbose flag to kubectl gather command to allow verbose gather logs, and add --verbose flag to the drenv gather job.
The second change is only for debugging and we probably want to revert it after we debug the issue of stuck gather job:
https://github.com/RamenDR/ramen/actions/runs/12712182155/job/35437188040