Delayed webhooks and scenario on US1-enterprise zone

This incident has been resolved.

All systems are back to normal operation.
We expect the queue of scenario activity logs to be fully processed within 4 hours and we will keep monitoring the situation until then.

The cluster’s scenario execution functionality has been restored and all queued executions have been processed. The backlog of scenario execution log entries is being processed at a slower rate and activity logs for completed executions will be displayed in the scenario history with a delay.

We are continuing to work on a fix for this issue.

We have identified the likely root cause of the problem and started implementing corrective action. We will provide another update in the next 30 minutes.

We are continuing to investigate this issue.

We are investigating delays with webhook processing and scenario processing on US1-enterprise zone. We will update this incident in 30 min with more details.