Outage in DigitalOcean

LON1 Networking

Resolved Minor
February 02, 2023 - Started almost 2 years ago - Lasted about 2 hours
Official incident page

Need to monitor DigitalOcean outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including DigitalOcean, and never miss an outage again.
Start Free Trial

Outage Details

Our Engineering team is currently investigating reports of connectivity issues in our LON1 region. Maintenance is ongoing as per https://status.digitalocean.com/incidents/pqsgdmyzyy0k and we are working to determine if the root cause is related to that maintenance. At this time, users may see timeouts and errors when connecting to services in LON1. We'll post an update with further information as soon as possible.
Latest Updates ( sorted recent to last )
RESOLVED almost 2 years ago - at 02/03/2023 01:22AM

From 20:20 - 23:25, we experienced a partial outage of VPC traffic in our LON1 region. This outage was triggered by an underlying bug uncovered by the maintenance activities in https://status.digitalocean.com/incidents/pqsgdmyzyy0k.

Public networking was unaffected, but Load Balancers, Managed Kubernetes Clusters, Managed Databases, App Platform, Functions, and Droplet-to-Droplet traffic flowing via VPC was impacted.

We sincerely apologize for the disruption triggered by the maintenance activities we performed. We've successfully run this maintenance in multiple regions without any impact, but going forward, we will ensure the bug discovered here is not present before rolling out the upgrades to the remaining regions.

MONITORING almost 2 years ago - at 02/03/2023 12:04AM

Our Engineering team has confirmed the mitigation was successful and traffic is flowing normally again. Services dependent on VPC traffic were impacted, which include Load Balancers, Managed Databases, Managed Kubernetes Clusters, App Platform, and Functions. We've also confirmed the impact from this outage was triggered by the activities in the maintenance here: https://status.digitalocean.com/incidents/pqsgdmyzyy0k

We're now monitoring and will post an update once we confirm this issue is fully resolved.

IDENTIFIED almost 2 years ago - at 02/02/2023 11:38PM

Mitigation efforts are now 100% complete and we are seeing restoration of connectivity. We're confirming with multiple Engineering teams that the mitigation was successful and will post an update soon.

IDENTIFIED almost 2 years ago - at 02/02/2023 11:31PM

Our Engineering team has identified the root cause of the issue and is now mitigating it. These efforts are approximately 35% complete. We'll continue to post updates.

INVESTIGATING almost 2 years ago - at 02/02/2023 11:26PM

Our Engineering team has confirmed impact to Load Balancers, Managed Databases, Managed Kubernetes Clusters, and App Platform. Connectivity directly to Droplets does not appear to be affected.

INVESTIGATING almost 2 years ago - at 02/02/2023 11:07PM

Our Engineering team is currently investigating reports of connectivity issues in our LON1 region. Maintenance is ongoing as per https://status.digitalocean.com/incidents/pqsgdmyzyy0k and we are working to determine if the root cause is related to that maintenance. At this time, users may see timeouts and errors when connecting to services in LON1.

We'll post an update with further information as soon as possible.

Keeping track of cloud vendor outages shouldn't be hard

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3260 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime