-
Notifications
You must be signed in to change notification settings - Fork 40.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix node notReady in first sync period after kubelet restart #124430
fix node notReady in first sync period after kubelet restart #124430
Conversation
Hi @AllenXu93. Thanks for your PR. I'm waiting for a kubernetes member to verify that this patch is reasonable to test. If it is, they should reply with Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. |
…before syncNodeStatus
8073088
to
3c67445
Compare
Please provide a release-note for it as this is a user-facing change. |
What do you think about using this approach instead #124397 (comment) ? |
/triage accepted |
/lgtm Dawn this will improve the p99 percentiles on node startup as it seems there is a race that can postpone the node readiness by 10 seconds
|
LGTM label has been added. Git tree hash: 7826400af9f6ba80406770076a90449375efe27f
|
@aojea thanks for pointing out the overall improvement on the node startup latency even the original issue shouldn't cause any other disruption to the running workloads if there is any. cc/ @yujuhong @bobbypage for vis. /lgtm |
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: AllenXu93, dchen1107 The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
/milestone v1.31
|
fix nodeNotReady once after kubelet restart: execute updateRuntimeUp before syncNodeStatus
What type of PR is this?
/kind bug
What this PR does / why we need it:
When kubelet start, it will execute
kl.syncNodeStatus
to sync node status to APIServer, and one of the check is checking containerRuntime state.But containerRuntime state update execute after
kl.syncNodeStatus
kubernetes/pkg/kubelet/kubelet.go
Lines 1625 to 1641 in bf07ef3
This PR will execute
kl.updateRuntimeUp()
beforekl.syncNodeStatus
.Which issue(s) this PR fixes:
Fixes #124397
Special notes for your reviewer:
Does this PR introduce a user-facing change?
Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.: