Pipelines are delayed in reporting completion

We are receiving reports that pipelines are taking a long time to complete. Our team is investigating.

No substantial updates at this time. Our team is still investigating the issue.

Our team has identified some issues that contributed to PG Bouncer saturation and increased sidekiq load. While this has decreased significantly, we're continuing to investigate the root cause.

We are no longer seeing delays on new jobs. For existing jobs in a stuck state, cancelling and retrying the job should resolve the problem. If you can’t cancel and restart a pipeline, cancelling an early job in the pipeline and restarting it may also recover the pipeline.