CI pipelines failed to start on GitLab merge requests for approximately 3.3 hours due to Sidekiq workers deferring job processing. Engineers identified the root cause and worked through the backlog, with job queues and runner backlogs gradually returning to normal. The incident resolved as systems processed the remaining queued jobs, with engineers continuing to monitor stability.
Trusted by 1,000+ teams
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
We are currently investigating an issue affecting CI pipelines not starting on merge requests. Our team is actively investigating the root cause.
We have identified that the sidekiq workers processing the jobs are getting deferred. The team is working on identifying the remediation steps.
No material updates to report. We are continuing to investigate the current issue and engineers are working to determine remediation steps.
Our engineers are still investigating the issue but jobs are starting to be processed with a delay. More details can be found here:
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22412
Queues and runner backlog are trending back towards normal, while systems continue to work through the remaining backlog. Engineers are continuing to monitor this.
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with