GitLab experienced CI pipeline processing delays for 1 hour due to background job processing issues, with small CI runners being primarily affected by increased job queuing rates. The incident was caused by a Sidekiq backlog that led to CI job accumulation and subsequent delays. The team observed recovery by the end of the incident period while continuing to investigate the root cause.
Our team is investigating potential delays with background job processing. This could impact CI/CD job processing.
We're seeing increased job queuing rates that are primarily affecting small CI runners. Our team is still investigating.
No material updates at this time, our team is still investigating the issue.
Our team is still investigating the issue.
Our team is seeing some recovery but are still investigating the root cause. We believe that a previous Sidekiq backlog caused CI jobs to accumulate, leading to delays. More detail in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21532
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6020 services available
Integrations with