Outage in Grafana

Read Errors on loki-prod3 Cluster

Resolved Minor
March 31, 2023 - Started about 1 year ago - Lasted 4 days
Official incident page

Need to monitor Grafana outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Grafana, and never miss an outage again.
Start Free Trial

Outage Details

As of 1400 UTC, we were alerted to a series of read errors stemming from the loki-prod3 cluster. At this time, some users may encounter 504 read errors when attempting to query for logs making use of the mentioned cluster. Engineering is aware and actively investigating. We will continue to provide updates as information is shared.
Components affected
Grafana US-CENTRAL
Latest Updates ( sorted recent to last )
MONITORING about 1 year ago - at 03/31/2023 03:57PM

As of 1545 UTC, we have observed marked improvement to the loki-prod3 cluster and are currently monitoring for reoccurrence. At this time, customers should no longer experience 504 read errors when querying Loki.

We will continue to monitor and provide updates.

INVESTIGATING about 1 year ago - at 03/31/2023 03:18PM

As of 1400 UTC, we were alerted to a series of read errors stemming from the loki-prod3 cluster. At this time, some users may encounter 504 read errors when attempting to query for logs making use of the mentioned cluster.

Engineering is aware and actively investigating. We will continue to provide updates as information is shared.

The easiest way to monitor Grafana and all cloud vendors

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3153 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime