Aiven experienced a 6.1-hour incident where node lifecycle management delays disrupted service operations including creating, deleting, scaling, and maintaining services. What began as a DigitalOcean-specific issue was found to affect all cloud providers (AWS, GCP, Azure, UpCloud, and DigitalOcean), though existing running services and Aiven for MySQL remained unaffected throughout. A mitigation was implemented and operations returned to normal, with a backlog of pending operations gradually clearing.
Trusted by 1,000+ teams
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
We have implemented a mitigation for the infrastructure issue affecting node lifecycle management, and we are now seeing service operations return to normal.
We are closely monitoring the platform to ensure stability. Pending operations such as service creations, deletions, and maintenance updates are beginning to process, though it may take some time to clear the remaining backlog.
We have identified that the previously reported issue affecting node lifecycle management is not isolated to a single cloud provider, but is currently affecting services across all cloud providers.
As a result, any operations that require creating, or replacing nodes will experience significant delays regardless of the underlying cloud hosting platform. We have stopped all pending maintenance updates to help mitigate the impact.
Impacted operations across all providers include:
- Creating new services
- Powering services up
- Scheduled maintenance updates
- Service scaling and plan upgrades
Note: Aiven for MySQL services are completely unaffected by this issue. For all other service types, existing, running services remain unaffected and continue to operate normally. Our engineering teams are actively working to resolve the root cause across our infrastructure, and we will provide further updates as the situation develops. We apologize for the continued inconvenience.
We are currently investigating an issue affecting services running on DigitalOcean that is causing delays in node lifecycle management. As a result, any operations on DigitalOcean-hosted services that require creating, deleting, or replacing nodes will experience delays.
Impacted operations (on DigitalOcean only) include:
• Creating new services
• Deleting existing services
• Powering services up or down
• Scheduled maintenance updates
• Service scaling and plan upgrades
Note: Existing, running services on DigitalOcean are currently unaffected and operating normally. Services running on other cloud providers (AWS, GCP, Azure, UpCloud) are completely unaffected. Our engineering team is actively working to resolve the issue, and we will provide further updates as soon as more information is available. We apologize for the inconvenience.
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with