-
Notifications
You must be signed in to change notification settings - Fork 39.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
kubelet ignores updated etcd.yaml
and monitors only etcd.yaml.backup
#129364
Comments
/sig node |
/remove-kind node |
@rad1k4l: Those labels are not set on the issue: In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
/remove-sig cluster-lifecycle You should find out who created the file. (That is the root cause of your problem) /kind feature
|
/remove-kind feature |
/retitle kubelet ignores updated |
etcd.yaml
and monitors only etcd.yaml.backup
/triage accepted |
Is it ignored because the name of the pod is the same? |
What happened?
During the
kubeadm upgrade
process,kubeadm
creates a backup of the existing etcd manifest (etcd.yaml.backup
) and updates theetcd.yaml
manifest to a newer version (e.g., from etcd 3.4.13-0 to 3.5.16-0). However, post-upgrade, thekubelet
appears to ignore the updatedetcd.yaml
and continues to monitor and apply changes only toetcd.yaml.backup
. This behavior prevents the etcd cluster from upgrading, causing thekubeadm upgrade
process to fail.What did you expect to happen?
After initiating the kubeadm upgrade:
How can we reproduce it (as minimally and precisely as possible)?
There are two methods to reproduce the issue: Automated Upgrade via kubeadm and Manual Updating of etcd.
Automated Upgrade via kubeadm:
etcd.yaml.backup
and updatesetcd.yaml
to version 3.5.16-0.kubelet
ignoresetcd.yaml
(verison 3.5.16-0 ) and only monitorsetcd.yaml.backup
( version 3.4.13-0), preventing the etcd upgrade.Manual :
Create a backup of the existing
etcd.yaml
file:cp /etc/kubernetes/manifests/etcd.yaml /etc/kubernetes/manifests/etcd.yaml.backup
Open etcd.yaml in a text editor and update the etcd image version from
3.4.13-0
to3.5.16-0
.Restart the kubelet service:
systemctl restart kubelet
Anything else we need to know?
No response
Kubernetes version
Cloud provider
OS version
Install tools
Container runtime (CRI) and version (if applicable)
Related plugins (CNI, CSI, ...) and versions (if applicable)
The text was updated successfully, but these errors were encountered: