A code change caused 500 errors across GitLab's REST and GraphQL API endpoints for 9.4 hours. GitLab identified the problematic code change and reverted it, with the fix fully deployed to production by the end of the European business day. Users experienced API failures until the revert was completely rolled out, with a temporary workaround available through the Canary environment.
We have identified a code change that provokes 500 errors for API requests. We are currently reverting the change. Workaround in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21573
The revert change has been merged, users will still experience 500 errors until the fix reaches production. We estimate it will be fully deployed at the end of EMEA day. More details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21573
The fix has now reached Canary environment, users can enable it by clicking "Next" at https://next.gitlab.com/ until the fix reaches production. More details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21573
The fix has reached production and users should not experience 500 errors on API calls. We will be monitoring the fix before marking this incident as Resolved. More details https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21573
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6020 services available
Integrations with