Grafana experienced service degradation on the Loki logs read path in AWS US West starting around 13:25 UTC, causing timeouts and 5xx errors when customers attempted to query logs. The incident affected the prod-us-west-0 cluster and lasted approximately 6.2 hours before being resolved. Services began stabilizing around 16:35 UTC with continued monitoring, and the issue was considered fully resolved by 20:31 UTC after observing sustained stability.
We continue to observe a continued period of stability since 19:40 UTC. At this time, we are considering this issue resolved
Since 16:35 UTC we have experienced stability and services are recovering. We are actively monitoring and working to fully stabilize
Our engineering team is investigating issues on the read path of Loki services on AWS US West since today aroun ~13:25UTC.
These issues can cause timeouts and 5xx errors when query logs for customers on the cluster. The team is currently working to restore the service.
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6020 services available
Integrations with