Outage in Google Cloud
Global: Increased rate of 500s and latency in L7ILB / rL7XLB Envoy
Resolved Minor
March 17, 2023 - Started about 3 years ago
- Lasted 3 days
Incident Report
Summary: Global: Increased rate of 500s and latency in L7ILB / rL7XLB Envoy
Description: Engineering team has mitigated the issue in asia-south1 region and currently working on rollback for all global regions starting at 2023-03-17 12:00 US/Pacific.
The ETA for the rollback is not known at this time.
We will provide more information by Friday, 2023-03-17 14:00 US/Pacific.
Diagnosis: 500s responses returned from Envoy load balancers. Additional latency on queries passing through the load balancer and receive query errors depending on backend timeouts.
Workaround: Customers can increase timeouts in their LB to reduce the impact.
Components affected
Google Cloud NetworkingTrusted by 1,000+ teams
Never miss outages in third-party dependencies
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
Latest Google Cloud outages
Multiple GCP products are experiencing Service issues - 11 months ago
Google Compute Engine (GCE) issue impacting multiple dependent GCP services across zones - about 1 year ago
Customers are experiencing connectivity issues with multiple Google Cloud services in zone us-east5-c - about 1 year ago
Apigee customers may experience unable to login to Admin UI portal. - about 1 year ago
Never miss outages in third-party dependencies
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with
