#Maintenance
Changelog (2025) 24
- 2025-12-08
Upgraded cluster add-ons
The following updates have been rolled out to all non-production clusters. As usual there are also improvements across various other add-ons, ensuring enhanced performance and security: amazon-eks-ami v20251120 Root block volume has been migrated from gp2 …
- 2025-12-08
Migrated to new ECR Basic Scanning version
We have successfully migrated all managed AWS accounts to the new version of ECR Basic Scanning, which uses Amazon’s native scanning technology. What Changed ECR Basic Scanning: Upgraded from the previous version to AWS_NATIVE scanning technology …
- 2025-11-13
Upgrading EKS clusters to v1.33 + node auto repair feature
Update 2025-10-21: These changes have been rolled out to all clusters. We are rolling out EKS v1.33. Please make sure to update to our recommended client versions matching this upgrade. This upgrade promotes the in-place resource resize API to beta, …
- 2025-10-13
Upgraded Concourse CI to version 7.14.2
Concourse CI has been upgraded to version 7.14.2. This release comes with a UI bugfix for Chrome v141. You can find the full changelog on GitHub: Concourse v7.14.2 Release Notes
- 2025-09-25
Upgraded cluster add-ons
The following updates have been rolled out to all non-production clusters. As usual there are also improvements across various other add-ons, ensuring enhanced performance and security: amazon-eks-ami v20250904 aws-ebs-csi-driver v1.48.0-eksbuild.2 …
- 2025-09-23
OpenSearch maintenance: improved monitoring and upgrading to 2.19
We have redone our OpenSearch monitoring setup to rely on the CloudWatch integration instead of using elasticsearch-exporter. This allows us to monitor metrics more reliably and closer to the AWS setup. You will also notice a brand new Grafana dashboard …
- 2025-08-21
Upgraded Concourse CI to version 7.14.1
Concourse CI has been upgraded to version 7.14.1. This release comes with several improvements and bug fixes. In addition, we have updated our Concourse authentication flow by plugging it into the same Dex instance that is used for other services like …
- 2025-08-06
Upgraded cluster add-ons
The following updates have been rolled out to all non-production clusters. As usual there are also improvements across various other add-ons, ensuring enhanced performance and security: amazon-eks-ami v20250715 aws-ebs-csi-driver v1.46.0-eksbuild.1 …
- 2025-07-04
Upgraded cluster add-ons
Update 2025-07-15: These changes have been rolled out to all clusters. The following updates have been rolled out to all non-production clusters. As usual there are also improvements across various other add-ons, ensuring enhanced performance and security: …
- 2025-07-02
Skyscrapers report on security incident
We’re choosing to share this incident publicly, although not without hesitation. Being transparent about security issues is uncomfortable and feels scary. But we believe it’s important to follow our own values. Trust is built not by hiding mistakes, but by …
- 2025-06-25
Loki label optimisations to improve performance, rollout finished
We have finished deploying our announced changes to the default indexed labels and structured metadata we assign to Loki logs. Please read on to know what changes have been made and how this impacts you. Please reach out if you have any questions, need …
- 2025-06-16
Fixed subnet & route association bug
Last week we rolled out a fix for a bug in our VPC route table association logic. This bug could cause some EKS worker node subnets to not be associated with the correct route table for its respective Availability Zone (AZ). This could lead to non-optimal …
- 2025-06-10
Grafana CVE-2025-4123 mitigation
On 21/05 Grafana disclosed a high severity security vulnerability, identified as CVE-2025-4123. We want to inform you that last week we rolled out mitigations for this vulnerability to all our managed clusters. In the end we don’t believe our …
- 2025-05-20
[ACTION REQUIRED] Upgraded cluster add-ons
The following updates have been rolled out to all clusters. As usual there’s improvements across various add-ons, ensuring enhanced performance and security. There’s possibly some actions required on your side regarding Grafana, so please read …
- 2025-05-08
[ACTION REQUIRED] Loki label optimisations to improve performance
We intend to make breaking changes to the Loki labels we assign to logs collected from your clusters. These changes aim to improve Loki’s performance by reducing high-cardinality labels and removing duplicates (e.g. namespace removed in favor of …
- 2025-04-17
Upgraded cluster add-ons
The following updates have been rolled out to all non-production clusters. As usual there’s also improvements across various other add-ons, ensuring enhanced performance and security. There’s no notable major updates. aws-ebs-csi-driver …
- 2025-04-11
Upgrading Concourse CI to version 7.13.1
Concourse CI has been upgraded to version 7.13.1. This release only updates the bundled resource-types, specifically the s3 and registry-image resources. Both resources had bugs related to their upgrade to v2 of the AWS Go SDK. You can find the full …
- 2025-04-08
Upgrading Concourse CI to version 7.13.0
Concourse CI has been upgraded to version 7.13.0. This update includes the following changes: Worker Rebalancing: Improved worker selection logic to better balance workloads across available workers. Bugfixes: Resolved some issues related to ATC (the API …
- 2025-03-25
All clusters patched against IngressNightmare (CVE-2025-1097, CVE-2025-1098, CVE-2025-1974, CVE-2025-24513, CVE-2025-24514)
Last night Kubernetes sent out a Security Advisory regarding multiple vulnerabilities in the Nginx Ingress Controller, including the critical CVE-2025-1974. If you’re an AWS account owner, you likely also received an email from AWS warning against …
- 2025-03-12
Upgraded cluster add-ons
Update 2025-03-24: These changes have been rolled out to all clusters. The following updates have been rolled out to all non-production clusters. As usual there’s also improvements across various other add-ons, ensuring enhanced performance and …
- 2025-02-10
Upgrading Concourse CI to version 7.12.1
Concourse CI has been upgraded to version 7.12.1. This update brings some small improvements. Relevant Concourse CI changelog: https://github.com/concourse/concourse/releases/tag/v7.12.1
- 2025-02-05
Upgrading EKS clusters to v1.32
We are rolling out EKS v1.32. Please make sure to update to our recommended client versions matching this upgrade. This upgrade includes an important change in how PersistentVolumeClaims (PVCs) are handled by StatefulSets. When a StatefulSet is deleted, …
- 2025-01-23
[ACTION REQUIRED] Upgraded cluster add-ons
The following updates have been rolled out to all non-production clusters. Notable updates include a major release for Prometheus, bringing a new UI. As usual there’s also improvements across various other add-ons, ensuring enhanced performance and …
- 2025-01-07
Upgrading EKS clusters to v1.31
We are rolling out EKS v1.31. Please make sure to update to our recommended client versions matching this upgrade. Timeline: Testing & rollout to non-production clusters has happened in the past days Production rollouts are expected to finish at the …