MCO1 lag on events processing

Event processing and alert raising is back to real time since 21h30 CET.
Event storage is back to real-time since 23h.
This incident is now over.

The whole platform is up again since 19:05 CET.
We are processing the backlog of events and raising alerts accordingly.
The estimated time before recovering to real-time processing is just above 2 hours.
Events storage is catching up a little bit slower, so events will not show instantly after being processed.

We are still monitoring the behavior and will let you know when everything is back to real-time.
Thank you for your patience.

Hello,
During today's region upgrade, the upgrade of a critical service for events processing is taking an abnormally long time due to a restart failure, which restarted its upgrade procedure from start.
The impact is a substantial delay on events processing (more than an hour).
The fix has instantly been implemented to prevent the same failure but it still takes a long time to restart entirely.
We are monitoring it closely and will take you updated.