Datacenter Cooling Event - Southeast Asia - Extended Mitigation

Impact Statement:Starting around 20:19 UTC on 7 February 2023, a utility power surge in the Southeast Asia region tripped a subset of cooling units offline in one of the Availability Zones. While working to restore the cooling units, temperatures in the datacenter increased and we have proactively powered down a small subset of compute and storage units to avoid damage to hardware and reduce cooling system load.All impacted storage and compute scale units are in the same datacenter, within one of the region’s three Availability Zones (AZs). Multiple downstream services have been identified as impacted. Current Status – 03:30 UTCWe are continuing to focus our efforts on mitigation for services which were impacted due to this incident. The core storage and compute services restoration have been completed successfully.We have several other key services fully recovered and for some of which we are still working on post recovery checks. We are closely monitoring the datacenter metrics for storage and compute resources which continue to show healthy thresholds.We will continue to provide updates as we have further progress towards service restoration. We will share our next update in 2 hours or as events warrant.