Outage in Grafana

Loki SLO Burn Rate Very High

Resolved Minor
March 28, 2024 - Started over 1 year ago - Lasted 5 days
Official incident page

Incident Report

On 3/28/2024, at approximately 13:58 UTC, our team identified an issue causing users to see read and write 5xx errors and degraded ruler evaluations. We have identified the issue and are working on deploying a solution.
Components affected
Grafana GCP India - prod-ap-south-0 Grafana GCP UK - prod-gb-south-0 Grafana GCP Australia - prod-au-southeast-0 Grafana Azure US Central - us-central2 Grafana AWS India - prod-ap-south-1 Grafana Azure Netherlands - prod-eu-west-3 Grafana AWS US East - prod-us-east-0 Grafana AWS Sweden - prod-eu-north-0 Grafana GCP Belgium - prod-eu-west-0 Grafana GCP US Central - prod-us-central-0 Grafana AWS Australia - prod-au-southeast-1 Grafana GCP Brazil - prod-sa-east-0 Grafana AWS Germany - prod-eu-west-2 Grafana AWS Brazil - prod-sa-east-1 Grafana AWS Canada - prod-ca-east-0 Grafana AWS Singapore - prod-ap-southeast-1 Grafana GCP Singapore - prod-ap-southeast-0 Grafana US-CENTRAL Grafana AWS US West - prod-us-west-0
The Status Page Aggregator Built for IT Teams

One place to monitor all your cloud vendors. Get instant alerts when an outage is detected.

Try IsDown risk-free 14-day free trial · No credit card required
Latest Updates ( sorted recent to last )
RESOLVED over 1 year ago - at 04/02/2024 07:30AM

This incident has been resolved.

MONITORING over 1 year ago - at 03/28/2024 02:51PM

A fix has been implemented and we are monitoring the results.

IDENTIFIED over 1 year ago - at 03/28/2024 02:44PM

On 3/28/2024, at approximately 13:58 UTC, our team identified an issue causing users to see read and write 5xx errors and degraded ruler evaluations. We have identified the issue and are working on deploying a solution.

Latest Grafana outages

New users registered in Synthetic Monitoring from October 15th are no able to create checks - 1 day ago
Synthetic Probe Connectivity Issues - 2 days ago
Loki degraded writes in SouthEast region - 3 days ago
Machine learning unavailable for the prod-us-west-0 region - 7 days ago
AWS Firehose Logs Down in Prod-Us-West-0 - 8 days ago

The Status Page Aggregator Built for IT Teams

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 4522 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook