Provisioning: Degraded Performance in Job Processing

This incident has been resolved. We are working on the RCA and will publish it here asap

Our Provisioning Team has been closely tracking queue performance over the last few hours and has noted steady improvements. We are moving this incident to Monitoring status.
We will continue to monitor queue processing closely and will update this page on any changes.

Still, the global provisioning system is not working properly.
Therefore, all other dependencies, like K8s and managed products, are affected, too.
We know this is affecting customer setups, and that urgent changes are not processed properly, and we apologize for the inconvenience.
We identified possible distractors, but fixing this is a complex task, with need to involve and coordinate several technical teams.
We are working with highest prio to get the provisioning back working,
and we will let you know asap on any progress.

We are currently investigating instances of performance degradation in job processing. Our Provisioning Team is currently working on fixing the root cause of these events.