Outage in Google Cloud

Large Vertex Model Garden Deployment may experience failures.

Resolved Minor
November 04, 2024 - Started about 2 months ago - Lasted about 8 hours

Need to monitor Google Cloud outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Google Cloud, and never miss an outage again.
Start Free Trial

Outage Details

Summary: Large Vertex Model Garden Deployment Failures Description: We are experiencing an issue with Vertex Model Garden Deployments. Our engineering team continues to investigate the issue. We will provide an update by Monday, 2024-11-04 14:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Customers may experience failures with large Vertex Model Garden deployments (greater than 100GB) when deployed on a GKE Autopilot cluster. Workaround: None at this time.
Components affected
Operations Vertex AI Online Prediction (europe-west3) Vertex AI Online Prediction (australia-southeast1) Vertex AI Online Prediction (asia-northeast3) Vertex AI Online Prediction Vertex AI Online Prediction (asia-east2) Vertex AI Online Prediction (asia-southeast1) Vertex AI Online Prediction (europe-west2) Vertex AI Online Prediction (northamerica-northeast1) Vertex AI Online Prediction (asia-northeast1) Vertex AI Online Prediction (europe-west1) Vertex AI Online Prediction (us-west1) Vertex AI Online Prediction (us-west2) Vertex AI Online Prediction (europe-west4) Vertex AI Online Prediction (europe-west6) Google Cloud Infrastructure Components Vertex AI Online Prediction (asia-south1) Vertex AI Online Prediction (asia-east1) Cloud Developer Tools Vertex AI Online Prediction (northamerica-northeast2) Vertex AI Online Prediction (us-east4) Vertex AI Online Prediction (us-east1) Vertex AI Online Prediction (us-central1) Cloud Machine Learning

Latest Google Cloud outages

Vertex Gemini API and Vertex AI in Firebase customers in us-central1 are experiencing elevated errors for requests to Gemini models - 2 days ago
We are experiencing an issue with Vertex Gemini API in Asia - 2 days ago
Mandiant Attack Surface Management is experiencing some ASM collection scan results to be delayed - 6 days ago
Mandiant Attack Surface Mangement is experiencing some ASM collection scan results to be delayed - 7 days ago
Support case comments may not be viewable in Cloud Console - 8 days ago

Be the first to know when Google Cloud and other third-party services go down

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3278 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime

Start today for FREE