Intermittent 400 errors when logging into GitLab.com

Users are intermittently seeing 400 Bad Request errors when attempting to log into GitLab.com. This does not seem to be affecting all users at the moment and investigation is ongoing. See https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21436 for details.

No material updates to report at this time. We continue tracing the errors to determine the root cause. Follow https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21436 for details.

We’ve identified a recent deployment that may be contributing to this issue and are preparing a rollback to see if it improves the situation. Keep tuned for more updates on https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21436.

Rollback is still in progress. We’ll update this status page as soon as we have new information to share. See https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21436 for details.

The rollback has completed, but we are not yet seeing a reduction in the frequency of the error messages. Investigation continues, see https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21436 for details.

We are now investigating whether an upstream component could be contributing to the behavior, though this has not yet been confirmed. See https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21436 for updates.

We started reviewing a recent change to our HTTP router as a contributing factor, but have now ruled it out and continue investigating other potential causes. We’ll provide another update once we have new information to share.

We are involving Cloudflare to investigate a potential upstream problem and have reached out for their assistance. Please follow https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21436 for details.

We continue working with Cloudflare support to figure out the cause of these errors. We will update this incident as any findings come along. See https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21436 for details.

Cloudflare has identified a potential lead on their side and is investigating further. We will update this status page once we have more information to share from their side. Follow https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21436 for details.

Cloudflare has declared a public incident to investigate this issue on their end. Please follow https://www.cloudflarestatus.com/incidents/t2skq2t69g5s and https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21436 for details.

The upstream Cloudlfare incident has been resolved and now we monitor to confirm the login error is no longer present in our logs before proceeding to resolve this incident. See https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21436 for details.