Google Cloud Infrastructure Components Incident #20013

Preliminary Incident Statement while full Incident Report is prepared. (All Times US/Pacific) Incident Start: 2020-12-14 03:45 Incident End: 2020-12-14 04:35 Duration: 50 minutes; Affected: Services: Google Cloud Platform, Google Workspace Features: Account login and authentication to all Cloud services Regions/Zones: Global Description: Google Cloud Platform and Google Workspace experienced a global outage affecting all services which require Google account authentication for a duration of 50 minutes. The root cause was an issue in our automated quota management system which reduced capacity for Google’s central identity management system, causing it to return errors globally. As a result, we couldn’t verify that user requests were authenticated and served errors to our users. Customer Impact: GCP services (including Cloud Console, Cloud Storage, BigQuery, Google Kubernetes Engine) requiring authentication would have returned an error for all users. Google Workspace services (including Gmail, Calendar, Meet, Docs and Drive) requiring authentication would have returned an error for all users. Additional Details: Many of our internal users and tools experienced similar errors, which added delays to our outage external communication. We will publish an analysis of this incident once we have completed our internal investigation.