Vertex AI Online Prediction, Dialogflow CX, and Agent Assist are experiencing elevated error rates in multiple regions.

Summary: Vertex AI Online Prediction Experiencing 50X Error or Canceled Requests Intermittently. Description: We are experiencing an intermittent issue with Vertex AI Online Prediction beginning on Wednesday, 2024-06-12 12:06 US/Pacific. Mitigation work is currently underway by our engineering team. However, we do not have an ETA for mitigation at this point. We will provide more information by Wednesday, 2024-06-12 18:00 US/Pacific. We apologize to all who are affected by the disruption. Diagnosis: Customers that are impacted due to this issue may observe 50X errors while executing prediction tasks. Customers may also see canceled requests for any running prediction tasks. Workaround: None at this time.