Changelog
This changelog lists all updates, improvements and new features our Engineering team develops for our Skyscrapers Reference Developer Platform. These are rolled out automatically to all DevOps-as-a-Service customers.
2018 Q4
- 2018-11-13
Maintenance
Set resource requests and limits for all infrastructure pods
We’ve recently adjusted resource requests and limits for all Pods running in the infrastructure namespace. Previously, some of them didn’t have requests nor limits, and some others had unnecessary high values. We’ve reviewed the CPU and …
- 2018-11-13
Maintenance
Moving from kube-lego to cert-manager for automatic TLS certificates
We’re moving the Letsencrypt service on our Kubernetes from the deprecated kube-lego to cert-manager. Cert-manager comes with a whole set of new features, mainly the ability to use the dns01 ACME challenge for certificate validation. This means you …
- 2018-11-05
Maintenance
Grafana Pods dashboard updated memory metrics
We’ve updated the Pods dashboard so it displays both the actual container memory usage (container_memory_working_set_bytes) next to the previous metric including caches (container_memory_usage_bytes). You can find this dashboard in your grafana …
- 2018-10-30
Maintenance
Releasing our user-level documentation repository
Today we’re releasing a new user-level knowledge base of our products and services. It’s aimed to help you be more confident and autonomous in managing your applications on our platforms. You can find it in the following GitHub repository: …
- 2018-10-23
Maintenance
K8S upgrade to stretch
We upgraded and tested our test cluster successfully to Debian stretch now that all open issues are resolved. This change makes the K8S stack more future proof because we are running on the current stable release of Debian called stretch. This also allows …
2018 Q3
- 2018-09-28
Maintenance
Vault data is now backed up
Our Vault setup is configured to store the data in a DynamoDB table, using Vault DynamoDB storage backend. DynamoDB already replicates all the data in a table across three availability zones, giving Vault high availability and data durability. From today, …
- 2018-09-28
Maintenance
Teleport upgrade to 2.7.5
Teleport has been upgraded to version 2.7.5 for all users. This upgrade includes various bugfixes and performance improvements, as well as additional functionality such as scp (secure copy) from the web interface. You can find the full changelog on the …
- 2018-09-28
Maintenance
Kubernetes cluster-autoscaler enabled
Today we release the addition of the Kubernetes Cluster AutoScaler to our clusters. Since we’ll be enabling the autoscaler by default, we’ll be initially deploying it on staging while production clusters will follow in a couple of days. Before …
- 2018-09-25
Maintenance
Reduced number of NAT gateways
We’ve reduced the number of NAT gateways per VPC. In the previous setup we created one NAT gateway per VPC where we routed all the non-k8s traffic, and we had three NAT gateways just for the k8s cluster (one for each Availability Zone). In total we …
- 2018-09-25
Maintenance
Kubernetes Infrastructure Tools Upgraded
We have updated our internals infrastructure tools to the latest version. These upgrades add bugfixes and several new features. The upgraded tools include: Dex (2.10.0) nginx-ingress (0.19.0) kube-lego (0.1.7) external-dns (0.5.6) kube2iam (0.10.4) Some …
- 2018-09-20
Maintenance
Upgrade logging to Kibana and Elasticsearch 6.3
We use Elasticsearch with Kibana to aggregate logs from Kubernetes and our customers’ applications. Today this stack got upgraded to 6.3, bringing several improvements and bug fixes. Elasticsearch On the Elasticsearch side this mainly fixes a bug …
- 2018-09-19
Maintenance
Concourse version 4.2.1 upgrade
We’ve upgraded all the Concourse setups to the latest available version, that’s 4.2.1. As you might have read in the previous post from concourse we were working on the upgrade to Concourse 4.1. During that process we ran into some bugs that we …
- 2018-09-13
Maintenance
Concourse version 4.1.0 upgrade
We’ve upgraded all the Concourse setups to the latest available version, that’s 4.1.0. We have upgraded our test concourse cluster from v3.14.1 to v4.1.0. Customer clusters will follow shortly after we have confirmed there are no issues with …
- 2018-09-12
Maintenance
Upgrade to Kubernetes 1.10
Update: Changed Kubernetes update from 1.10.7 to 1.10.8 We have upgraded our staging Kubernetes clusters from v1.9.8 to v1.10.8. Production clusters will follow in 1 to 2 weeks (to be announced) after we have confirmed there are no issues with our …
- 2018-08-29
Maintenance
Reduced logging verbosity for system components
Some of our infrastructure components were logging extensively to CloudWatch logs and Elasticsearch, filling up precious disk space for our customers. We have now reduced the logging verbosity of those components.
- 2018-08-28
Maintenance
Better networking monitoring
We’ve improved the monitoring for the Kubernetes clusters monitoring component, a.k.a. Calico. We’ll now have more insights in how the networking is behaving in case of trouble. You’ll see there’s an extra dashboard in Grafana …
- 2018-08-25
Maintenance
Added AWS Inspector on Kubernetes cluster nodes
The AWS Inspector agent is now installed by default on all nodes. Get in touch if you’d like to configure Inspector Assessments.
- 2018-07-31
Maintenance
OIDC proxy for Kubernetes dashboard and other endpoints
We’ve rolled out an OIDC proxy in front of all dashboards of your Kubernetes cluster, including Grafana and Prometheus. So you can access those dashboards via GitHub authentication, instead of needing to go through a VPN.
- 2018-07-02
Maintenance
Upgrade to Concourse v3.14.1
We’ve upgraded all the Concourse setups to the latest available version, that’s 3.14.1. Most of the changes are bug fixes, some performance improvements and minor features. You can check the official Concourse changelog here: …