Outage in Datadog US1

Delayed Processing for a Subset of Metrics

Resolved Minor
August 01, 2023 - Started over 1 year ago - Lasted about 9 hours
Official incident page

Need to monitor Datadog US1 outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Datadog US1, and never miss an outage again.
Start Free Trial

Outage Details

We are investigating increased latency processing Processing for Distribution Metrics coming from the agent. As a result of this issue, some users may see delays or gaps for a subset of their metrics on graphs. RUM/Synthetics/Logs/Processes measures that depend on distribution metrics will also see delays. To prevent spurious alerts, we have temporarily disabled monitors based on this data.
Components affected
Datadog US1 Metrics Pipeline Datadog US1 Synthetics Datadog US1 Logs Datadog US1 Alerting Engine Datadog US1 Processes
Latest Updates ( sorted recent to last )
RESOLVED over 1 year ago - at 08/02/2023 05:45AM

This incident has been resolved.

MONITORING over 1 year ago - at 08/02/2023 03:08AM

Distribution metrics lag has been resolved. As a result of the issue, some users may see gaps for distribution metrics on graphs. Monitors evaluation is now re-enabled for monitors based on this data.

MONITORING over 1 year ago - at 08/02/2023 12:43AM

We continue to make progress on processing the lag on distribution metrics and are monitoring any further issues.

MONITORING over 1 year ago - at 08/01/2023 10:57PM

We continue to process the lag on distribution metrics

MONITORING over 1 year ago - at 08/01/2023 09:42PM

A fix has been implemented and we are monitoring the results.

IDENTIFIED over 1 year ago - at 08/01/2023 09:37PM

The issue has been identified and a fix is being implemented.

INVESTIGATING over 1 year ago - at 08/01/2023 09:37PM

We are continuing to investigate this issue.

INVESTIGATING over 1 year ago - at 08/01/2023 09:07PM

We are continuing to investigate this issue.

INVESTIGATING over 1 year ago - at 08/01/2023 09:05PM

We are investigating increased latency processing Processing for Distribution Metrics coming from the agent.
As a result of this issue, some users may see delays or gaps for a subset of their metrics on graphs.
RUM/Synthetics/Logs/Processes measures that depend on distribution metrics will also see delays.
To prevent spurious alerts, we have temporarily disabled monitors based on this data.

Latest Datadog US1 outages

Monitors - Delayed Evaluation - 3 days ago
Monitors - Delayed Evaluation for Distribution Metric Monitors - 3 days ago
Delayed Distribution Metrics - 8 days ago
Delayed distribution metrics & monitor notifications - about 1 month ago
Delayed Distribution Metrics - about 1 month ago

The best way to monitor Datadog US1 and all your third-party services

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3273 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime

Start today for FREE