Performance problems with CI

There is an ongoing incident with our CI Postgres cluster. Some CI jobs are getting delayed. For more information please see the incident (https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8541)

No material updates at the moment. Our teams are still investigating the root cause of the problem. For more information please see https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8541

Our teams are still investigating the root cause of the issue, currently, we are analyzing loads in our databases to pinpoint the saturation on Patroni. For more information please see https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8541

Our teams are assessing recent partition tables to the database to determine if a recently implemented change on the database is creating the loads on Patroni, for more information please see https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8541

Our team has identified a recently enabled feature that is possibly causing the load issue with Patroni. We have disabled the feature and are currently working on evaluating the performance changes. https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8541

Disabling the feature flag resulted in a decrease in load in Patroni, our team is monitoring the load to make sure that the loads get back to normal values. For more information: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8541

Our team is monitoring the load to make sure that the loads get back to normal values. For more information: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8541

Our team is still monitoring the load to make sure that the loads get back to normal values. For more information: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8541