Outage in DigitalOcean

Managed Databases Operations - MySQL

Resolved Minor
November 24, 2022 - Started almost 3 years ago - Lasted about 14 hours
Official incident page

Incident Report

At 07:00 UTC, our Engineering team identified an issue with backups on MySQL Managed Databases. At this time, we recommend users not perform any maintenance or migrate MySQL database instances as there could be data loss. We will share an update as soon as further information is available.

Need to monitor DigitalOcean outages?

One place to monitor all your cloud vendors. Get instant alerts when an outage is detected.

Try IsDown risk-free 14-day free trial · No credit card required
Latest Updates ( sorted recent to last )
RESOLVED almost 3 years ago - at 11/25/2022 01:02AM

As of 23:13 UTC, our Engineering team has put tooling in place to detect clusters running the impacted version of MySQL. Affected clusters will be mitigated when that detection tooling is triggered, so backups can still be created.

We will continue rolling out the permanent fix but have identified this issue impacts a very small number of Managed Databases and users are no longer at risk of loss of data integrity.

Due to this, we will be closing out this status page.

If you have any questions or concerns, please open a ticket with our Support team (being sure to use our backup form if you experience any issues with our Support Portal as per https://status.digitalocean.com/incidents/gdvprb8bwhtp).

Thank you.

IDENTIFIED almost 3 years ago - at 11/24/2022 01:47PM

Our Engineering team is still working on a patch to fix the backup issue on MySQL Managed Database clusters. We will first remediate the affected clusters, then roll out a permanent fix to all MySQL clusters.

We apologize for the inconvenience and will share an update once we have more information.

IDENTIFIED almost 3 years ago - at 11/24/2022 11:09AM

At 07:00 UTC, our Engineering team identified an issue with backups on MySQL Managed Databases.

At this time, we recommend users not perform any maintenance or migrate MySQL database instances as there could be data loss.

We will share an update as soon as further information is available.

The Status Page Aggregator Built for IT Teams

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 4522 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook