Data packet loss affecting Southeast Asia region in Azure (APSOUTHEAST-AZURE-1 - Singapore)

At 18:50 PM UTC, we started receiving health alerts related to SouthEast Asia (APSOUTHEAST-AZURE-1 CXP) region in Azure. Upon investigation, we noticed the data tunnels that were going in and out of this region were either flapping or down. Further investigation revealed that traffic within APSOUTHEAST-AZURE-1 CXP was working fine; however any anything leaving the region was either not working or working intermittently. At 20:08 PM UTC, the issue was entirely resolved automatically without any intervention from our side.

We engaged Azure support to get more details about the incident and they confirmed that there was a hardware failure in a core router in Singapore, which impacted outbound connectivity and cross-region communications. Their engineering team has moved the router out of rotation and has updated that most services have recovered, though minor congestion in some locations is being addressed. We will follow up with Azure for a detailed RCA.

Please reach out to Alkira support if you have any questions.

Azure confirmed about incident affecting SouthEast Asia region. The issue has been mitigated and services have recovered. We will continue to monitor the region for some more time.

Details from Azure about the incident:
There was an incident in our SouthEast Asia and Korea Central regions. The incident was caused by a hardware failure in a core router in Singapore, which impacted outbound connectivity and cross-region communications. The engineering team has moved the router out of rotation and have updated that most services have recovered, though minor congestion in some locations is being addressed.

We noticed all the health status recovered for Southeast Asia region in Azure. We are still investigating the reason for the same. As of now, all the health status reports are active.

We are currently observing data packet loss affecting Southeast Asia region in Azure (APSOUTHEAST-AZURE-1 - Singapore). We are actively investigating this incident and update on the status as soon as possible.