Outage in AWS

Increased API error rates and event delivery latencies

Resolved Minor
November 25, 2020 - Started almost 5 years ago - Lasted over 1 year

Need to monitor AWS outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including AWS, and never miss an outage again.
Start Free Trial

Outage Details

6:45 AM PST We are investigating increased API error rates for EventBridge in the US-EAST-1 Region.

8:37 AM PST We are continuing to investigate increased API error rates for EventBridge in the US-EAST-1 Region.

9:06 AM PST We can confirm significant API faults and latencies for EventBridge in the US-EAST-1 Region, which is related to an ongoing issue with Kinesis Data Streams. We are continuing to work towards resolution.

10:44 AM PST We can confirm significant API faults and latencies for EventBridge in the US-EAST-1 Region, which is related to an ongoing issue with Kinesis Data Streams. Currently, customer calls to the PutEvents API are failing with 5XX unavailable errors. In addition, rules subscribing to events from AWS services are delayed. We are continuing to work towards resolution.

1:36 PM PST We have identified the root cause of elevated API errors and latencies in US-EAST-1. While we are seeing partial recovery, we continue to see elevated error rates and latency on API calls to PutEvents. Additionally, Rules subscribing to Events from other AWS Services continue to be delayed as we work toward full resolution.

3:24 PM PST We have identified the root cause of elevated API errors and latencies in the US-EAST-1 Region and have begun implementing mitigations resulting in partial recovery. We continue to see elevated error rates and latency on API calls to PutEvents. Additionally, for Rules subscribing to Events from other AWS Services, latency is recovering but still elevated. We are continuing to work towards full resolution.

4:04 PM PST We have identified the root cause of elevated API errors and latencies in the US-EAST-1 Region and have implemented mitigations resulting in significant improvement in error rates and latency on the PutEvents API. We continue to see delays in Rules subscribing to Events from other AWS Services and are working towards full resolution.

6:04 PM PST Newly published events are no longer experiencing elevated delivery latencies, however, we continue to see delays in Rules subscribing to events from other AWS Services that were delivered earlier in the day and are working towards full resolution.

7:33 PM PST Newly published events are no longer experiencing elevated delivery latencies. We continue to see delays in Rules subscribing to scheduled events that were delivered earlier in the day and we are working through backlog of these events over the next few hours.

9:52 PM PST Between 5:15 AM and 9:30 PM PST, we experienced elevated API errors and event delivery latency in the US-EAST-1 Region related to an issue with Kinesis Data Streams. While the issue has been resolved and the service is operating normally, we are continuing to work through the backlog of AWS CloudTrail events which will be delivered over the next several hours.
Components affected
Amazon EventBridge (us-east-1)

The Status Page Aggregator with Early Outage Detection

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 4484 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook