Changelog
This changelog lists all updates, improvements and new features our Engineering team develops for our Skyscrapers Reference Developer Platform. These are rolled out automatically to all DevOps-as-a-Service customers.
2021 Q3
- 2021-09-10
Maintenance
Mute critical KubeAPIErrorBudgetBurn alerts
We have muted the critical KubeAPIErrorBudgetBurn alerts. The KubeAPIErrorBudgetBurn alerts are used to measure the SLO and is meant to point to issues or bad performance of the APIServer. While we will still receive the warning alerts we won’t route …
- 2021-09-09
Maintenance
VPA enabled by default
During the last year we have tested out the Vertical Pod Autoscaler on several of our workloads and customers. These results were positive and therefore we decided to roll out the VPA on all our clusters. By default we deploy autoscaling rules for …
- 2021-09-07
Maintenance
Downgraded Grafana to v7.5
Last month we rolled out a major Grafana update, going from 7.5 to 8.1. While initially everything looked in order, some customers experienced issues with their custom dashboards which were working perfectly in the previous release. Mainly data coming from …
- 2021-09-06
Maintenance
Cert-manager upgraded to 1.4.4
We’ve upgraded Cert-manager to the version 1.4.4 on all our Kubernetes clusters. This patch upgrade contains a bug-fix for a renewal time issue that affected some of our clusters. The upgrade is already released on all clusters and environments.
- 2021-08-31
Maintenance
Vault upgraded to 1.8.2
We are in the process of upgrading our Kubernetes based Vault setups to the latest version 1.8.2. This release contains features and bug fixes. For full details and other changes, please refer to the upstream Vault release notes: …
- 2021-08-26
Maintenance
Vault upgraded to 1.8.1
We are in the process of upgrading our Kubernetes based Vault setups to the latest version 1.8.1. This release contains features and bug fixes. For full details and other changes, please refer to the upstream Vault release notes: …
- 2021-08-10
Maintenance
Upgraded cluster components & increased Pod density. Actions to take!
As part of our regular upgrade cycle, the following Kubernetes cluster components have been updated. We’ve already rolled these out to all clusters. Some highlights: Max pod density per node increased to 110! Major releases for Grafana IngressClasses …
- 2021-08-04
Maintenance
Reduced memory usage of Cluster Autoscaler
In an effort to optmize as much as possible the resources being used by the infrastrucutre components running on our Reference Solution Kubernetes platforms, we’ve considerably reduced the memory used by the Cluster Autoscaler by optimizing its …
- 2021-08-02
Maintenance
Upgraded Teleport to version 6.2.8
We’ve upgraded all Teleport clusters to version 6.2.8. Coming from version 4.x, this is a (double) major release, coming with many new features: Application access: users can use Teleport to securely proxy to (web-)applications with SSO, as an …
- 2021-07-22
Maintenance
Concourse upgraded to v7.3.2
We have upgraded our Concourse setups to the latest version 7.3.2. This upgrade only contains features and bugfixes, no breaking changes. You can check the full changelog here.
- 2021-07-19
Maintenance
Using encryption at rest for Prometheus and Alertmanager
We’re switching to encrypted volumes for all our Prometheus and Alertmanager set ups. These were the last of our managed infrastructure components to receive encryption at rest. You don’t need to take any further actions regarding this matter, …
- 2021-07-06
Maintenance
Pod Disruption Budget for CoreDNS
In order to improve the resilience of CoreDNS during upgrades, we have added a Pod Disruption Budget for the CoreDNS pods. The CoreDNS deployment already has a proper update strategy and anti affinity applied, however the extra PDB will prevent the …
2021 Q2
- 2021-06-24
Maintenance
Using Telepresence in our Reference Solution
Telepresence is an open source tool that allows cluster users and operators to access cluster services and resources as if they were running in a local network. It also allows a developers to debug Kubernetes services locally and run local services as if …
- 2021-06-18
Maintenance
GP2-encrypted is now the default storageclass
We’re making the use of encryption at rest our default. For this we switched our default PV storageclass on K8s from gp2 to gp2-encrypted. So if you will create a PVC without specifying the volume type K8s will provision a gp2-encrypted volume …
- 2021-06-14
Maintenance
Always use encryption at rest for OpenVPN storage
We’re making the use of encryption at rest our default and only option for OpenVPN storage. Until now it was enabled by default, but it was still possible to disable it. In our effort to increase the security of our reference solution and that of our …
- 2021-06-10
Maintenance
Support for RabbitMQ and AmazonMQ monitoring
We’ve added support for monitoring both self-hosted RabbitMQ and AmazonMQ for RabbitMQ clusters through Prometheus. The monitoring coverage differs slighly for those two services. For self-hosted RabbitMQ, the minimum required version is 3.8.0 and it …
- 2021-06-09
Maintenance
Initial support for Milvus database
We have added initial support for Milvus. It is available as an optional add-on for all customers using our Kubernetes Reference Solution on AWS. Milvus is an open-source vector database that is highly flexible, reliable, and blazing fast. It supports …
- 2021-06-04
Maintenance
Upgrade AKS and EKS clusters to 1.20
We have started rolling out AKS and EKS 1.20. This brings AKS on Kubernetes v1.20.7 and EKS on Kubernetes v1.20.4-eks-6b7464. In the process of upgrading EKS the following components have also been upgraded: KubeProxy from v1.19.6 to v1.20.4-eksbuild.2 …
- 2021-06-04
Maintenance
Encrypted storage layer of Teleport
We’ve updated all Teleport clusters so the underlaying volume that is used is encrypted. For this we are using Amazon EBS encryption. This change has been rolled out to all clusters and does not require any follow up.
- 2021-06-03
Maintenance
Istio dashboards in Grafana
We have added the official Istio dashboards to Grafana. If you have Istio enabled on your cluster the following dashboards are now available: Mesh Dashboard provides an overview of all services in the mesh. Service Dashboard provides a detailed breakdown …
- 2021-05-27
Maintenance
Istio upgraded to version 1.10.0
We have upgraded Istio on all clusters that use it. The version was upgraded from 1.9.2 to 1.10.0. The new version comes with some features meant for operators and no breaking changes that you should be aware of. You can check the full release notes here. …
- 2021-05-25
Maintenance
Vault upgraded to 1.7.2
We have upgraded our Kubernetes based Vault setups to the latest version 1.7.2. This release contains features, bug fixes and 1 CVE fix. For full details and other changes, please refer to the upstream Vault release notes: …
- 2021-05-18
Maintenance
Upgraded several cluster components
As part of our regular upgrade cycle, the following Kubernetes cluster components have been updated. We’ve already rolled these out to all non-prod clusters and production will follow in the coming days. Click each link to go to the full upstream …
- 2021-05-18
Maintenance
Adding support for EFS backed Persistent Volumes in Kubernetes
We’ve added a new component to our AWS Kubernetes reference solution, the EFS CSI driver. This adds support for using EFS file systems in EKS clusters with PersistentVolumes. The driver is already rolled out to all staging EKS clusters, and will be …
- 2021-05-12
Maintenance
Concourse upgraded to v7.2.0
We have upgraded our Concourse setups to the latest version 7.2.0 This upgrade includes the following breaking changes: Wait for worker matching strategy when scheduling build steps: Previously, if no workers satisfied the container placement strategy for …