Outage in PowerOutage.us

Increased web request error rates

Resolved Major

September 26, 2022 - Started over 3 years ago - Lasted about 7 hours
Official incident page

Incident Report

We are continuing to see increased web request error rates due to extremely high abnormal traffic which is circumventing our page caching. We are working on implementing an emergency mitigation.

Need to monitor PowerOutage.us outages?

Monitor all your external dependencies in one place
Get instant alerts when outages are detected
Be the first to know if service is down
Show real-time status on private or public status page
Keep your team informed

Start monitoring for free

Latest Updates ( sorted recent to last )

RESOLVED over 3 years ago - at 09/27/2022 05:47AM

DNS changes have been successfully propagated to core DNS servers.
No additional issues have been found.

Issue is being closed, but we will continue to monitor server health in detail.
Feel free to reach out to support@bluefirestudios.com or join our discord discord.gg/PRrqwe7dpD if you have any questions!

MONITORING over 3 years ago - at 09/27/2022 01:07AM

A few API requests from customers were getting blocked by the new traffic filtering rules.
We have made some modifications to prevent authorized clients with valid API keys from get caught in the filters.

We continue to monitor server health as the DNS changes propagate.

MONITORING over 3 years ago - at 09/27/2022 12:16AM

We implemented a few additional abnormal traffic protections, and added an additional web cluster of servers to deal with the excessive abnormal load.

We have seen two more abnormal spikes in traffic that have not resulted in additional 50x errors.

Currently we are waiting for full DNS propagation and monitoring server health.

In total there have been about 11 minutes where portions of incoming requests were being dropped by overloaded servers.

IDENTIFIED over 3 years ago - at 09/26/2022 11:08PM

We are continuing to see increased web request error rates due to extremely high abnormal traffic which is circumventing our page caching.

We are working on implementing an emergency mitigation.

Latest PowerOutage.us outages

Azure Central Region Connectivity Issues - over 1 year ago

GeoJson Outages API endpoint errors. - over 2 years ago

Investigating increased web request error rates - over 3 years ago

Maps not loading on PowerOutage.us / PowerOutage.com - over 3 years ago

Power Outage Systems not updating - about 4 years ago

The Status Page Aggregator with Early Outage Detection

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 6020 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook