Increased 522 errors in API requests

We are seeing an increased rate of 522 errors in API requests. This is causing pipelines to randomly fail, but can affect also other components. We are investigating possible mitigation actions. More details are available in https://gitlab.com/gitlab-com/gl-infra/production/-/issues/19432.

We are doing a rolling service restart which should fix the issue. More details can be found in https://gitlab.com/gitlab-com/gl-infra/production/-/issues/19432.

The Rolling restart did not help. We are investigating alternative options to fix this. This incident is being tracked in https://gitlab.com/gitlab-com/gl-infra/production/-/issues/19432.

We have observed the error rates to have dropped and are investigating the root cause of the issue with infrastructure vendors. This incident is being tracked in gitlab.com/gitlab-com/gl-infra/production/-/issues/19432.