Changelog
This changelog lists all updates, improvements and new features our Engineering team develops for our Skyscrapers Reference Developer Platform. These are rolled out automatically to all DevOps-as-a-Service customers.
2021 Q1
- 2021-02-02
Maintenance
Striving for more automation on the K8s reference solution
We’ve recently improved in the automation of our Kubernetes reference solution in several ways. Automation is very important for us to be able to quickly deliver new features and bug fixes to our customers, while performing seamless rollouts that …
- 2021-01-26
Maintenance
Grafana main dashboard updated
By default we integrated our Grafana deployments with Dex for handling authentication. We’ve now also made it possible to configure any other supported Grafana authentication backend, for example to use Azure AD directly.
- 2021-01-26
Maintenance
Automated AWS ELasticsearch Service backups to S3
By default, the AWS Elasticsearch Service already comes with regular automated snapshots. However these snapshots can not be used for recovery or migration to a new Elasticsearch cluster and furthermore can only be accessed as long as the Elasticsearch API …
- 2021-01-21
Maintenance
Velero S3 backups replication
Our reference solution eks-based Velero backups on AWS S3 now supports automatic replication to an additional S3 bucket on an AWS region of choice. The feature is disabled by default, contact your lead engineer to discuss about enabling it for your …
- 2021-01-20
Maintenance
Monitoring upgrades
As part of our regular upgrade cycle, the following Kubernetes cluster components have been updated. These updates are being rolled out to all clusters and will be finished by the end of the week. Most notable changes include bug fixes and minor …
- 2021-01-19
Maintenance
Concourse upgraded to v6.7.3
We have upgraded our Concourse setups to the latest version 6.7.3. This upgrade mainly contains minor new features and some bug fixes and performance improvements. You can check the full changelog here.
- 2021-01-12
Maintenance
Vault upgraded to 1.6.1
We have updated our Kubernetes based Vault setups to the latest version 1.6.1 in the past days. This release contains mostly bug fixes and 2 CVE fixes (nobody was affected by this). For full details and other changes, please refer to the upstream Vault …
2020 Q4
- 2020-12-18
Maintenance
Grafana main dashboard updated
We have fixed a problem in our main Grafana dashboard. Previously we counted the resources for all pods (including those who already completed). This gave an incorrect indication on the cluster usage. Now we filter out the failed and succeeded pods so the …
- 2020-12-15
Maintenance
Upgraded Dex version with security patch
We’ve upgraded Dex on all our clusters with a new version (v2.27.0) that contains a fix for a security vulnerability. Note that although the security vulnerability is considered critical, none of our clusters were impacted as it only affects the SAML …
- 2020-12-14
Maintenance
New log shipper added - Fluent Bit
We already offer a cost-effective and default logging solution based on Grafana Loki. However we realize this logging solution is not a perfect fit for everybody and thus now also allow deploying and configuring Fluent Bit through our reference solution …
- 2020-12-14
Maintenance
Configurable default certificate and default backend on nginx-ingress
The Nginx Ingress Controller has configuration options for setting a default TLS certificate and a default backend. We have now exposed this settings to be configurable on a per-cluster basis. The default backend is particularly interesting if you want to …
- 2020-12-08
Maintenance
Upgrade EKS to 1.18
We have started rolling out EKS 1.18. This brings EKS on Kubernetes v1.18.9. In the process of upgrading EKS the following components have also been upgraded: KubeProxy from 1.17.12 to 1.18.9 CoreDNS from 1.6.6 to 1.7.0 Cluster Autoscaler from 1.17.4 to …
- 2020-12-08
Maintenance
Updated Teleport to version 4.4.5
We’ve updated all Teleport clusters to version 4.4.5. This is a minor release, which includes mostly bugfixes and small improvements. In the meanwhile we discovered that we were not renewing the certificates on the teleport nodes. This is now also …
- 2020-12-04
Maintenance
Fixed issue with Vault certificate renewal
For increased security, our Vault setups are configured to terminate TLS sessions directly at the Vault server process. To do so, we use cert-manager to provision LetsEncrypt certificates that the Vault server Pods can use. There was an issue with this …
- 2020-11-30
Maintenance
Fall component upgrades
As part of our regular upgrade cycle, the following Kubernetes cluster components have been updated. We’ve already rolled these out to all staging clusters. Production clusters will follow in the coming days. Most notable changes include bug fixes …
- 2020-11-18
Maintenance
Support for GPU node pools in Azure Kubernetes Service (AKS)
We’re adding support for GPU node pools in AKS (Azure Kubernetes Service). GPU nodes are great for compute-intensive workloads such as graphics and visualization workloads, or machine-learning processes. Azure uses the NVIDIA device plugin to make …
- 2020-11-06
Maintenance
Support for Azure Kubernetes Service (AKS)
This is the first release of our Kubernetes Reference Solution for Azure AKS. For the past few months we’ve been working on porting our Kubernetes Reference Solution to Azure. Until now we only supported AWS EKS, but customer demand led to us to also …
- 2020-11-03
Maintenance
Concourse upgraded to v6.7.1
We have upgraded our Concourse setups to the latest version 6.7.1 (from version 6.6.0). This upgrade mainly contains changes to adapt to the rate limits of DockerHub. You can check the full changelog here.
- 2020-10-16
Maintenance
Improved monitoring for Kubernetes backups
We use Velero for automated backups of Kubernetes resources. Although we were scraping backup-related metrics into Prometheus, we hadn’t defined any automated alerts in case of backup failures. Our monitoring solution now fires a number of alerts …
- 2020-10-15
Maintenance
Concourse upgraded to v6.6.0
We have upgraded our Concourse setups to the latest version 6.6.0 (from version 6.5.1). This upgrade mainly contains minor new features and some bug fixes and performance improvements. You can check the full changelog here.
- 2020-10-12
Maintenance
Vault upgraded to 1.5.4
We have updated our Kubernetes based Vault setups to the latest version 1.5.4 in the past days. This release contains mostly bug fixes and most notably a security fix for CVE-2020-25816. Batch Token Expiry: We addressed an issue where batch token leases …
- 2020-10-08
Maintenance
Use the Vertical Pod Autoscaler to make your life easier and optimise cluster costs
As of today we offer the Vertical Pod Autoscaler as an optional component to your clusters. The Vertical Pod Autoscaler (VPA) frees the users from the necessity of setting up-to-date resource limits and requests for the containers in their pods. When …
2020 Q3
- 2020-09-29
Maintenance
Bugfix - Concourse workers out of disk space and crashing
We have identified a problem where our Concourse workers went unavailable. It turned out that the root EBS volume was filling up with logs too fast for the logrotation to take care of the archiving. We patched the workers to compress the old logs after …
- 2020-09-17
Maintenance
Kubernetes events now available in Loki
Next to your container logs, we now also ship Kubernetes events (kubectl get events -n <namespace>) to Grafana Loki. You can query these via {app="eventrouter", namespace="<mynamespace>"}. From Kubernetes docs: Kubernetes …
- 2020-09-15
Maintenance
Updated Teleport to version 4.3.5
We’ve updated all Teleport clusters and nodes to version 4.3.5. This is a major release, which includes a brand new UI. This should make Teleport in general easier to use, but more importantly the Audit Log is now also fully exposed through the UI. …