Changelog
This changelog lists all updates, improvements and new features our Engineering team develops for our Skyscrapers Reference Developer Platform. These are rolled out automatically to all DevOps-as-a-Service customers.
2025 Q3
- 2025-08-06
Maintenance
Upgraded cluster add-ons
The following updates have been rolled out to all non-production clusters. As usual there are also improvements across various other add-ons, ensuring enhanced performance and security: amazon-eks-ami v20250715 aws-ebs-csi-driver v1.46.0-eksbuild.1 …
- 2025-07-31
Announcements
[ACTION REQUIRED] Bitnami deprecates free container support
Bitnami has announced that starting August 28 2025, it will stop publishing free-of-charge supported container images and Helm charts. (Announcement: https://github.com/bitnami/charts/issues/35164) What’s changing? Bitnami will stop updating and supporting …
- 2025-07-04
Maintenance
Upgraded cluster add-ons
Update 2025-07-15: These changes have been rolled out to all clusters. The following updates have been rolled out to all non-production clusters. As usual there are also improvements across various other add-ons, ensuring enhanced performance and security: …
- 2025-07-02
Maintenance
Skyscrapers report on security incident
We’re choosing to share this incident publicly, although not without hesitation. Being transparent about security issues is uncomfortable and feels scary. But we believe it’s important to follow our own values. Trust is built not by hiding mistakes, but by …
2025 Q2
- 2025-06-25
Maintenance
Loki label optimisations to improve performance, rollout finished
We have finished deploying our announced changes to the default indexed labels and structured metadata we assign to Loki logs. Please read on to know what changes have been made and how this impacts you. Please reach out if you have any questions, need …
- 2025-06-25
New Features
Introducing the "Platform Info" file
We’re rolling out a small new feature which cretes a file called ${cluster-name}-platform-info.yaml in the k8s-clusters directory of our customer git repositories. This file contains some basic, non-sensitive, information about the platform, such as …
- 2025-06-16
Maintenance
Fixed subnet & route association bug
Last week we rolled out a fix for a bug in our VPC route table association logic. This bug could cause some EKS worker node subnets to not be associated with the correct route table for its respective Availability Zone (AZ). This could lead to non-optimal …
- 2025-06-10
Maintenance
Grafana CVE-2025-4123 mitigation
On 21/05 Grafana disclosed a high severity security vulnerability, identified as CVE-2025-4123. We want to inform you that last week we rolled out mitigations for this vulnerability to all our managed clusters. In the end we don’t believe our …
- 2025-05-26
Announcements
Addons migration from OpenTofu to Flux complete and next steps
In this post, we’re excited to share that we have successfully completed the migration of our Kubernetes (K8s) add-ons as announced in our previous post. The management of these add-ons has now transitioned from our existing OpenTofu-based approach (using …
- 2025-05-20
Maintenance
[ACTION REQUIRED] Upgraded cluster add-ons
The following updates have been rolled out to all clusters. As usual there’s improvements across various add-ons, ensuring enhanced performance and security. There’s possibly some actions required on your side regarding Grafana, so please read …
- 2025-05-08
Maintenance
[ACTION REQUIRED] Loki label optimisations to improve performance
We intend to make breaking changes to the Loki labels we assign to logs collected from your clusters. These changes aim to improve Loki’s performance by reducing high-cardinality labels and removing duplicates (e.g. namespace removed in favor of …
- 2025-04-17
Maintenance
Upgraded cluster add-ons
The following updates have been rolled out to all non-production clusters. As usual there’s also improvements across various other add-ons, ensuring enhanced performance and security. There’s no notable major updates. aws-ebs-csi-driver …
- 2025-04-11
Maintenance
Upgrading Concourse CI to version 7.13.1
Concourse CI has been upgraded to version 7.13.1. This release only updates the bundled resource-types, specifically the s3 and registry-image resources. Both resources had bugs related to their upgrade to v2 of the AWS Go SDK. You can find the full …
- 2025-04-08
Maintenance
Upgrading Concourse CI to version 7.13.0
Concourse CI has been upgraded to version 7.13.0. This update includes the following changes: Worker Rebalancing: Improved worker selection logic to better balance workloads across available workers. Bugfixes: Resolved some issues related to ATC (the API …
2025 Q1
- 2025-03-25
Maintenance
All clusters patched against IngressNightmare (CVE-2025-1097, CVE-2025-1098, CVE-2025-1974, CVE-2025-24513, CVE-2025-24514)
Last night Kubernetes sent out a Security Advisory regarding multiple vulnerabilities in the Nginx Ingress Controller, including the critical CVE-2025-1974. If you’re an AWS account owner, you likely also received an email from AWS warning against …
- 2025-03-17
New Features
Flux Image Reflector and Automation controllers
We are excited to announce that we have added two new controllers to our Flux setup: the Flux Image reflector and the Flux Image automation controller. These work together to update a Git repository when new container images are available. The Image …
- 2025-03-12
Maintenance
Upgraded cluster add-ons
Update 2025-03-24: These changes have been rolled out to all clusters. The following updates have been rolled out to all non-production clusters. As usual there’s also improvements across various other add-ons, ensuring enhanced performance and …
- 2025-03-05
Announcements
Migrating from OpenTofu to Flux: A leap forward in our Kubernetes management
In this post, we’re excited to announce our plans to shift the management of Kubernetes (K8s) add-ons from our existing OpenTofu-based approach (using Terragrunt and Concourse CI) to Flux. This change is part of our broader effort to simplify our platform …
- 2025-02-27
Announcements
DockerHub rate limits - system components updated
Since our previous announcement regarding the new DockerHub rate limits starting March 1st, we have updated and made sure that all system workloads managed by Skyscrapers, like ingress controllers, monitoring, istio etc., will not be affected by these new …
- 2025-02-21
Announcements
[ACTION REQUIRED] Change in DockerHub rate limits on March 1st 2025
Starting March 1, 2025 DockerHub will limit unauthenticated image pulls further from 100 per 6-hours per IP address to 10 per hour per IP address: https://docs.docker.com/docker-hub/usage/. This is a reduction of 40%! Please read this post carefully to …
- 2025-02-10
Maintenance
Upgrading Concourse CI to version 7.12.1
Concourse CI has been upgraded to version 7.12.1. This update brings some small improvements. Relevant Concourse CI changelog: https://github.com/concourse/concourse/releases/tag/v7.12.1
- 2025-02-05
Maintenance
Upgrading EKS clusters to v1.32
We are rolling out EKS v1.32. Please make sure to update to our recommended client versions matching this upgrade. This upgrade includes an important change in how PersistentVolumeClaims (PVCs) are handled by StatefulSets. When a StatefulSet is deleted, …
- 2025-01-30
New Features
New Dex onboarding docs and support for Google Group scope
We are excited to announce that we have completely rewritten our Dex onboarding documentation. This documentation will guide you through the steps required to configure your Identity Provider (like Google, Microsoft or Github) so we can integrate it as …
- 2025-01-23
Maintenance
[ACTION REQUIRED] Upgraded cluster add-ons
The following updates have been rolled out to all non-production clusters. Notable updates include a major release for Prometheus, bringing a new UI. As usual there’s also improvements across various other add-ons, ensuring enhanced performance and …
- 2025-01-22
New Features
New beta feature: Kubecost
We are excited to announce that we have added Kubecost as an optional feature to our Platform. Kubecost is a tool that helps you to manage your Kubernetes costs by providing visibility into your AWS and Kubernetes resource usage and costs. At the moment we …