GitLab experienced CI pipeline processing delays for 2 hours, where jobs were not being picked up by runners or remained stuck in pending status. The issue was caused by infrastructure capacity errors that prevented proper job execution. The incident was resolved by implementing an infrastructure change that improved pending job metrics.
Trusted by 1,000+ teams
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
We are investigating an issue with pipelines where jobs are not being picked up or they are stuck in pending. See issue for more details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21835
We are continuing to investigate the issue; there are no material updates to share at this time. Follow https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21835 for details.
We’ve identified some potential causes but haven’t yet confirmed the root cause of the problem. Investigation continues. Track progress: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21835
We are seeing infrastructure capacity errors and we’re inclined to treat this as the likely cause; investigation continues. Details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21835
We’ve rolled out an infrastructure change and pending job metrics are improving. We’ll continue to monitor. Follow the incident: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21835
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with