Incident with Actions, API Requests, Codespaces, Git Operations, Issues, Pages, Pull Requests and Webhooks

This incident has been resolved.

Reindexing is complete, and the /pulls and /search pages are up to date.

We’ve reindexed a little over half of the pull requests missing from the /pulls and /search pages.

We have reindexed about 20% of the pull requests missing from the /pulls and /search pages.

We’ve identified the full set of impacted pull requests not showing up on the /pulls and /search pages. We’ve kicked off a job to reindex them.

We’ve completed re-running the push jobs. We continue to investigate some pull requests not appearing in the /pulls and /search pages.

We’re continuing to investigate some pull requests not appearing in the /pulls and /search pages. Also, we continue to re-run the missed push jobs and webhooks.

We’re continuing to investigate some pull requests not appearing in the /pushes and /search pages. Also, we continue to re-run the missed webhooks.

We’re continuing to investigate a small number of pull requests not appearing on the /pulls and /search pages.

Pages is operating normally.

Actions, API Requests, Codespaces, Git Operations, Issues and Webhooks are operating normally.

Git operations are restored and operating normally. We are working on backfilling delayed pull request push updates from 13:30 to 13:55 UTC. Some webhooks sent during that window were not delivered.

We see recovery across most services and requests. We continue to recover from backlogs and are observing for additional impact. We’ll post another update within 30 minutes.

We have restored git operations and are seeing error rates return to normal. We are continuing to monitor for impact.

We are investigating issues with git operations leading to degraded experiences for many services. We will post an update within 30 minutes.

API Requests is experiencing degraded performance. We are still investigating and will provide an update when we have one.

Codespaces is experiencing degraded performance. We are continuing to investigate.

Actions, Git Operations, Pages and Webhooks are experiencing degraded performance. We are continuing to investigate.

We are investigating reports of degraded performance for Issues and Pull Requests.