[NL-AMS1]: Storage backends issue

This incident has been resolved

We thank you for your continued patience throughout this process and apologise for any impact.

The incident is now resolved, and all affected services should be operational. For any further issues please contact our Support team via live chat or email at support@upcloud.com

We are compiling a detailed post-mortem to outline the sequence of events, the steps taken to rectify the situation, and the measures we are implementing to prevent such occurrences in the future.

We understand the gravity of this disruption and extend our sincerest apologies to all affected customers.

Update: Our restoration efforts are in the last stretches and majority of the affected services in the NL-AMS1 data centre are now fully operational. A small number of individual customers services remain in an error state, and our engineering and support teams are diligently working to bring these services back online.

We expect full recovery very soon and appreciate your continued patience during this process.

We are committed to maintaining transparent communication and will provide the next comprehensive update at 16:00 UTC or as soon as the all customer services are fully operational - whichever is sooner.

Update: We’re making strong progress in bringing the affected services back online in the NL-AMS1 datacentre, and our efforts are focused on restoring the remaining services as quickly as possible.

We recognise the critical nature of these services and are doing everything necessary to restore full functionality as soon as possible.

We’ll provide the next update by 15:00 UTC or as soon as all services are fully restored, whichever comes first. Thank you for your continued patience.

Update: We are making good progress with restoring the remaining affected services in NL-AMS1 data centre.

Our team is fully engaged in the recovery process, and we want to assure you that we are taking this situation very seriously.

We are also committed to maintaining transparent communication and will provide the next update by 14:00 UTC or as soon as the services are fully available - whichever is sooner.

Update: Our team has identified the root cause of the issue at the NL-AMS1 datacentre and has made significant progress in the recovery process.

Many affected services are now back online, but there is still work to be done to bring the rest back to full operational status. We’re continuing our efforts to restore the remaining impacted services and expect further recovery in the coming hours.

We understand the gravity of the situation and are taking every measure to restore full service swiftly.
The next update will be provided at 13:05 UTC.

If you have any immediate concerns, our 24/7 live support team is available through the control panel.

We are currently investigating a storage backend issue affecting the NL-AMS1 datacentre.

This may impact Cloud Servers, Managed Kubernetes, Managed Databases and Object Storage. We recommend avoiding stopping/starting your server(s) at this time.

We are actively working to resolve this issue as swiftly as possible. We regret any inconvenience this might be causing and thank you for your patience as we work to address this.

If you have any questions or concerns, please feel free to contact our 24/7 live support in our control panel.