Outage in Grafana

Rule Performance Degradation

Resolved Minor
July 20, 2024 - Started about 1 year ago - Lasted 3 days
Official incident page

Need to monitor Grafana outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Grafana, and never miss an outage again.
Start Free Trial

Outage Details

We are currently investigating an issue with degraded performance with rule evaluation in us-central-0.loki. We will continue to investigate and provide updates as more information becomes available.
Components affected
Grafana GCP US Central - prod-us-central-0 Grafana US-CENTRAL
Latest Updates ( sorted recent to last )
RESOLVED about 1 year ago - at 07/22/2024 09:46PM

There were no observed instances of this issue today. We're considering the incident resolved. Please contact our Support team if you believe you're impacted by this incident.

MONITORING about 1 year ago - at 07/20/2024 12:25AM

Systems are stable again and we are continuing to monitor.

We will provide another status update if there are any changes.

INVESTIGATING about 1 year ago - at 07/19/2024 11:18PM

If you are experiencing queries taking longer to complete than expected, please cancel and retry them.

We will continue to investigate and provide updates as more information becomes available.

INVESTIGATING about 1 year ago - at 07/19/2024 10:30PM

Around 17:00 UTC we had noticed an impact that we are currently investigating with degraded performance with rule evaluation in the following clusters:
us-central-0/loki-prod
us-central-5/loki-prod-017
us-central-5/loki-prod3

We will continue to investigate and provide updates as more information becomes available.

INVESTIGATING about 1 year ago - at 07/19/2024 10:06PM

We are currently investigating an issue with degraded performance with rule evaluation in us-central-0.loki.
We will continue to investigate and provide updates as more information becomes available.

Latest Grafana outages

Cortex read/write partial outage - 5 days ago
Google Cloud Monitoring data source degraded performance in prod-us-central-0 - 6 days ago
Hosted Grafana - Grafana instances crashlooping - 7 days ago
Failures to ingest otel metrics .net apps - 12 days ago
Synthetic monitoring API outage - us-central2 - 14 days ago

The Status Page Aggregator with Early Outage Detection

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 4484 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook