Outage in Grafana
Issues with alert annotations in prod-eu-west-0 and prod-us-central-0
Resolved MinorIncident Report
As of 1:00 UTC, we became aware of an issue with alerting in the prod-eu-west-0 and prod-us-central-0 clusters. Users experiencing this issue may encounter issues with alert annotations not showing up and other degraded alert features.
Engineering is actively engaged and assessing the issue. We will provide updates accordingly.
Components affected
Grafana US-CENTRAL: Rule Evaluation Grafana EU-WEST: Rule evaluation Grafana EU-WEST: Alertmanager and Rules Configuration API Grafana US-CENTRAL: Alertmanager Grafana EU-WEST: Alertmanager Grafana US-CENTRAL: Alertmanager and Rules Configuration API
The Status Page Aggregator Built for IT Teams
One place to monitor all your cloud vendors. Get instant alerts when an outage is detected.
Try IsDown risk-free
14-day free trial · No credit card required
Latest Updates ( sorted recent to last )
RESOLVED
over 1 year ago - at 01/24/2024 02:40AM
Engineering has released a fix and as of 10:00 am UTC, customers should no longer experience any alerting issues.
IDENTIFIED
over 1 year ago - at 01/23/2024 02:53AM
We have partially worked out the issue, however, we had to scale down deployment in prod-us-central-0 and prod-eu-west-0. As a result of that, the previously mentioned issues with alert annotations not showing up and other degraded alert features have been mitigated, however, users may have trouble working with the SLO or Cloud Logs Exporter apps (creating/updating/deleting/listing objects).
INVESTIGATING
over 1 year ago - at 01/23/2024 01:29AM
As of 1:00 UTC, we became aware of an issue with alerting in the prod-eu-west-0 and prod-us-central-0 clusters. Users experiencing this issue may encounter issues with alert annotations not showing up and other degraded alert features.
Engineering is actively engaged and assessing the issue. We will provide updates accordingly.
Latest Grafana outages
New users registered in Synthetic Monitoring from October 15th are no able to create checks - 1 day ago
Synthetic Probe Connectivity Issues - 3 days ago
Loki degraded writes in SouthEast region - 3 days ago
AWS Firehose Logs Down in Prod-Us-West-0 - 8 days ago
The Status Page Aggregator Built for IT Teams
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 4522 services available
Integrations with
