Elevated Errors on US-3 Public Cloud

After monitoring, we've observed that the environment has remained stable. Services have been restored and authentication is functioning as expected. A root cause analysis (RCA) will be posted here within 14 days. We sincerely apologize for the impact this had on you and your users.

We have implemented mitigating actions and are observing a reduction of errors. We're monitoring the environment to ensure stability and that there is no recurrence of impact. The full root cause of the event is still undergoing investigation. We'll continue to update as we obtain more information.

We're continuing to analyze logs from the resources that support the impacted environment, which indicate server and query failures. Error rates continue to remain elevated on the Public Cloud environment. We'll continue to provide updates as our status changes.

Our investigation into this event is ongoing. Error rates continue to remain elevated at this time. We're inspecting error logs for potential insights into root cause. Further updates will be provided as our investigation progresses.

Our action to address the unexpected traffic to mitigate the issue did not fully recover service functionality. Error rates still remain elevated on the affected environment. We're extending our investigation to other potential root causes. We will continue to update as our status changes.

Our investigation has determined that a surge in unexpected traffic is consuming an inordinate amount of resources on the affected Public Cloud environment. To return services to normal levels we're taking mitigating steps to resolve impact. We will continue to update as our status progresses.

We are currently investigating an incident that impacted our services. Our team is actively working to understand the root cause and mitigate the issue. We will provide updates as we gather more information.