Outage in Displayr

Errors with R calculations in South East Asia region

Resolved Minor
February 08, 2023 - Started about 1 year ago - Lasted about 13 hours
Official incident page

Need to monitor Displayr outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Displayr, and never miss an outage again.
Start Free Trial

Outage Details

R calculations in the South East Asia region are taking a long time and then returning an error such as "There is a problem with your Internet connection that prevented the calculation from completing." We are investigating the cause of the errors. Other regions are not affected.
Latest Updates ( sorted recent to last )
RESOLVED about 1 year ago - at 02/08/2023 09:46PM

The R Servers in South East Asia region have now automatically recovered thanks to Microsoft Azure repairing the data center. This work is still on-going however Displayr's Azure resources in the data center have recovered and there is little risk that they will revert.

In terms of what Displayr could do to avoid this type of incident in future: our typical disaster recovery option would to have been to move the R Servers to an alternative region or zone in Azure that is within the same country (Singapore). Unfortunately there are no other Azure data centers available that could be used as a disaster recovery option, and all zones within the data center were affected.

An incident affecting an entire data center is highly unusual. This is the first time this incident has occurred since Displayr launched the South East Asia region in February 22, 2022. We have determined the risk of a similar incident occurring in future as very low.

IDENTIFIED about 1 year ago - at 02/08/2023 11:41AM

In regards to the South East Asia issue with R calculations, we are waiting for Azure to resolve the issue in the data center. All attempts to create separate R Servers in the same region have failed due to issues that impact the entire region. Please monitor the event "Datacenter Cooling Event - Southeast Asia" at https://azure.status.microsoft/en-gb/status

A workaround is available for customers that are affected in South East Asia and are not concerned with data sovereignty or data locality. The following steps will cause your data to leave South East Asia and be sent to the Australia East region. Only follow these steps if you accept the consequences of the data leaving your region.

1. Edit your Displayr document.
2. Wait for your document to load.
3. In the address bar of your browser, copy and paste the following line and press Enter

javascript:SeleniumTesting.QServerRequestsCommon.SetRServer({Request:"SetRServer",ServerName:"reausprod.displayr.com"})

4. The R Server for your document will have been temporarily changed to the Australia East region R Server. Any R calculations will now work.
5. You may have to repeat these steps after 10 minutes of inactivity.

IDENTIFIED about 1 year ago - at 02/08/2023 09:42AM

The issue is occurring due to an incident in the Azure South East Asia Data Center. Azure is still working on restoring services and they currently do not have an ETA. Here is a copy of their message:

> We do not have an exact ETA at this time, we currently expect an extended period of time to fully restore all cooling capacity. The Azure service recovery process will commence at this time and is expected to progressively return over a number of hours

https://azure.status.microsoft/en-gb/status

In the meantime, we are experimenting with a possible workaround.

INVESTIGATING about 1 year ago - at 02/08/2023 08:57AM

R calculations in the South East Asia region are taking a long time and then returning an error such as "There is a problem with your Internet connection that prevented the calculation from completing."

We are investigating the cause of the errors.

Other regions are not affected.

The easiest way to monitor Displayr and all cloud vendors

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3153 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime