Outage in Datadog US1

Delayed Processing for a Subset of Metrics

Resolved Minor

April 12, 2022 - Started almost 4 years ago - Lasted about 3 hours
Official incident page

Incident Report

We are investigating increased latency processing Processing for a Subset of Metrics. As a result of this issue, some users may see delays or gaps for a subset of their metrics on graphs. To prevent spurious alerts, we have temporarily disabled monitors based on this data.

Components affected

Datadog US1 Monitors Datadog US1 APM Datadog US1 Metrics and Infra Monitoring Datadog US1 Synthetics

Need to monitor Datadog US1 outages?

Monitor all your external dependencies in one place
Get instant alerts when outages are detected
Be the first to know if service is down
Show real-time status on private or public status page
Keep your team informed

Start monitoring for free

Latest Updates ( sorted recent to last )

MONITORING almost 4 years ago - at 04/12/2022 02:24PM

We have deployed a fix and we are monitoring the results. We are currently backfilling some delayed data and will provide another update once the issue is fully resolved.

IDENTIFIED almost 4 years ago - at 04/12/2022 01:18PM

We are continuing to work on a fix for this issue.

IDENTIFIED almost 4 years ago - at 04/12/2022 01:12PM

Fix has been implemented and we are monitoring recovery for delayed metrics and monitors. This only impacts distribution metrics and associated monitors.
As a result of this issue, some customers might also experience errors or incomplete data on some APM pages. We expect full recovery once all the delayed data has been backfilled.

IDENTIFIED almost 4 years ago - at 04/12/2022 12:39PM

The issue has been identified and a fix is being implemented.

INVESTIGATING almost 4 years ago - at 04/12/2022 11:22AM

We are continuing to investigate this issue.

INVESTIGATING almost 4 years ago - at 04/12/2022 11:13AM

We are investigating increased latency processing Processing for a Subset of Metrics.
As a result of this issue, some users may see delays or gaps for a subset of their metrics on graphs.
To prevent spurious alerts, we have temporarily disabled monitors based on this data.

Latest Datadog US1 outages

Delayed Events - 3 days ago

AP1 Web Application Not Loading - 7 days ago

Delayed Processes data - about 1 month ago

Delayed APM metric ingestion - about 1 month ago

Metrics data ingestion delayed and monitor evaluations degraded - about 1 month ago

The Status Page Aggregator with Early Outage Detection

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 5420 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook