Isolated Codespaces creation failures in the West Europe region

This incident has been resolved.

We are once again seeing signs of increased latency for codespace creation in this region, but are at the same time recovering previously unavailable resources.

Recovery continues slowly, and we are investigating strategies to speed up the recovery process.

We are continuing to see gradual recovery in the region and continue to validate the persistent fix.

The persistent fix has been applied, and are beginning to see improvements in the region. We are still working on follow-on effects, however, and expect recovery to be gradual.

We are nearing full application of the persistent fix and will provide more updates soon.

Mitigations we have put in place are yielding improvements in Codespace creation success rates in the affected region. We expect full recovery once the persistent fix fully rolls out.

We are continuing to work on mitigations while the more persistent fix rolls out.

We are continuing to apply mitigations while we deploy the more persistent fix. Full recovery is expected in 2 hours or less, but more updates will be coming soon.

We have applied some mitigations that are improving creation success rates while we work on the more comprehensive fix.

We have identified a possible root cause and are working on the fix.

Some Codespaces are failing to create successfully in the Western EU region. Investigating is ongoing.

Codespaces is experiencing degraded performance. We are continuing to investigate.

We are currently investigating this issue.