K8s Control Planes not available

We are marking this incident as resolved. A RCA will be published here once it is compiled.

The rollback was completed successfully. The team is currently checking the affected resources for potential residual inconsistencies. We are setting this incident into monitoring status.

We are currently rolling out the correction. We expect this to take several minutes and will update this page once the rollout is completed.

The team is now preparing to safely rollback identified changes on affected resources.

The team continues to audit affected resources to verify that all remaining inadvertent configuration changes are reverted.

Our Kubernetes engineering team has identified the root cause of the issue. The incident stemmed from a defect in a configuration filtering mechanism. We are currently implementing mitigation steps and will provide further updates on our progress here.

Some customers may experience connection problems to the control plane and degraded functionality of kubernetes.
Our engineers are working on a fix.