2026-10-20
Cluster add-on upgrades, with a new node image and safer node repair
#add-on #kubernetes #update #upgrade #component #eks #karpenter
We are rolling out the October round of cluster add-on upgrades. It ships to non-production clusters first, with production to follow. Most of it is routine patch and minor releases. A few changes are worth knowing about, and one may need a look if you configure Karpenter disruption budgets yourself.
What changed
- New EKS node image, so every node is replaced once. The node image moves to v20261012, which fixes a kernel panic AWS found in the previous two node images on some instance types. Karpenter replaces your nodes gradually, within your node pools’ disruption budgets, so workloads move the same way they do during any node rotation. We skipped those two affected images on purpose.
- Karpenter 1.15: node repair now respects your disruption budgets. When a node turns unhealthy, Karpenter replaces it. From this version that repair counts as a disruption, so a budget of
nodes: "0"withoutreasonsnow blocks repairs as well as consolidation. If you use such a budget to keep nodes stable during working hours,reasons: ["Drifted", "Underutilized", "Empty"]need to be added to it: your nodes stay put as before, and broken ones still get replaced. We already updated every cluster definition that had one. - KEDA 2.21 closes a security issue. Service account tokens that KEDA requests are now bound to their intended audience. This only affects a
TriggerAuthenticationthat usesboundServiceAccountTokenor Vault’s Kubernetes authentication. We found none on the clusters we checked; if you use either, let us know before your production rollout. - Tempo now applies your trace retention again. Since Tempo 3.0, traces were kept for 14 days whatever retention your cluster was set to. With this update the configured retention applies again, so traces older than it are removed once, shortly after the rollout.
- Stricter StorageClass checks. The EBS CSI driver now rejects a StorageClass with
allowedTopologiesthat names no availability zone. None of the StorageClasses we manage are affected; check any you created yourself. - Concourse 8.3.1. If you run Concourse with us, it moves to 8.3.1 with two security fixes. Paths given to pipeline steps can no longer climb out of their directory with
../; adjust any pipeline that relies on that. - secrets-store-csi-driver stays on 1.5.6. Newer versions can delete synced Kubernetes Secrets while pods still use them. We upgrade once a release fixes that.
Add-on upgrades
- alloy v1.21.0 (chart v1.14.0)
- amazon-eks-ami v20261012
- Replaces every node once; see above.
- aws-ebs-csi-driver v1.67.0
- StorageClasses with zone-less topologies are rejected; see above.
- aws-efs-csi-driver v3.5.1
- aws-load-balancer-controller v3.6.0
- aws-vpc-cni v1.23.2
- concourse v8.3.1 (chart v20.3.1)
- coredns v1.14.7
- dex v2.46.0 (chart v0.26.0)
- Dex now starts even when one login connector fails, instead of refusing all logins.
- eks-node-monitoring-agent v1.7.2
- flux v2.9.6
- fluent-bit v5.1.3 (chart v0.58.3)
- karpenter v1.15.0
- Node repair respects disruption budgets; see above.
- keda v2.21.0
- Security fix for service account tokens; see above.
- kube-prometheus-stack v92.10.1 (Prometheus Operator v0.94.1)
- Major chart version; the CRD update is applied automatically and Grafana dashboards, data sources and alerts keep working.
- grafana-loki v3.7.8 (chart v18.17.1, chart-only update)
- node-local-dns 1.27.1
- nvidia-device-plugin v0.20.1
- oauth2-proxy v7.15.5 (chart v10.7.1)
- prometheus-blackbox-exporter v0.29.0 (chart v11.20.0)
- tailscale-operator v1.104.1
- tempo v3.1.0 (chart v3.2.0)
- Configured trace retention applies again; see above.
- traefik v3.7.14 (chart v42.0.0)
- Major chart version; nothing changes in how your ingresses behave.
- velero v1.18.2 (chart v12.2.1), with velero-plugin-for-aws v1.14.4
- vertical-pod-autoscaler v1.8.0 (chart v0.14.0)
We also picked up the latest EKS build revisions for kube-proxy, metrics-server and the snapshot-controller (packaging updates only, no version change).