P1 - Systems Inaccessible

Hello,

We can confirm that our affected solutions have remained stable for the period since the last update.

As such we consider this incident as resolved.

Thank you.

We have continued to see an improvement across the Fourth suite of products and believe that overall they are in a stable condition.

Remedial actions undertaken by Microsoft may still have a small impact, but we firmly believe the situation will improve even further over the next hour.

We will continue to monitor throughout the evening and pending any further information, this Incident will be resolved at the start of the day tomorrow.

Thank you for your understanding.

We are able to confirm that we are seeing significant improvements in accessing our solutions, however we do believe that customers may still experience intermittent issues.

We will continue to monitor and provide further updates as the situation evolves.

A further update will be provided when we have more information.

Our investigation has confirmed issue experienced by Fourth Services look to be related a Global Azure issue. This has been confirmed by Microsoft.
We are seeing intermittent signs of recovery.

Fourth are actively exploring options to mitigate this issue and restore services to customers.

An update will be provided when we have further information.

Our investigation has confirmed issue experienced by Fourth Services look to be related a Global Azure issue.

This has been confirmed by Microsoft:
https://azure.status.microsoft/en-gb/status

Microsoft have advised:
We are taking several concurrent actions: Firstly where we are blocking all changes to the AFD services, this includes customer configuration changes as well. At the same time, we are rolling back our AFD configuration to our last known good state. As we rollback we want to ensure that the problematic configuration doesn't re-initiate upon recovery.

Customers may have experienced problems accessing the Azure management portal. We have failed the portal away from AFD to mitigate the portal access issues. Customers should be able to access the Azure management portal directly, while all portal extensions are working correctly there may be a small number of endpoints that might have a problem loading (i.e. Marketplace).

We do not have an ETA for when the rollback will be completed, but we will update this communication within 30 minutes or when we have an update.


In addition, Fourth are actively exploring options to mitigate this issue and restore services to customers.

An update will be provided when we have further information.

UPDATE from Microsoft:
Our investigation has confirmed issue experienced by Fourth Services look to be related a Global Azure issue. This has been confirmed by Microsoft:

https://azure.status.microsoft/en-gb/status

Microsoft have advised:
We have failed the portal away from AFD to mitigate the portal access issues. Customers should be able to access the Azure management portal directly.

We do not have an ETA for when the rollback will be completed, but we will update this communication within 30 minutes or when we have an update.

Fourth are actively exploring options to mitigate this issue and restore services to customers.

An update will be provided when we have further information.

Our investigation has confirmed issue experienced by Fourth Services look to be related a Global Azure issue. This has been confirmed by Microsoft:

https://azure.status.microsoft/en-gb/status

Microsoft have advised:
We are actively assessing failover options of internal services from our AFD infrastructure. Our investigation into the contributing factors and additional recovery workstreams continues. More information will be provided within 60 minutes or sooner.

We will provide further information when this becomes available.

UPDATE:

Our investigation has confirmed issue experienced to Fourth Services look to be related a Global Azure issue. This has been confirmed by Microsoft:

https://azure.status.microsoft/en-gb/status

We will provide further information when this becomes available.

We are aware of a critical incident that may be affecting some of our customers.

All indicators currently suggest there is widespread issue with Microsoft services.

Status and updates will continue here every 30 minutes until the incident has been resolved.

We apologise for this disruption to your service.

We are aware of a critical incident that may be affecting some of our customers.

This is incident is currently being verified to ascertain impact.

Status and updates will continue here every 30 minutes until the incident has been resolved.

We are aware of a critical incident that may be affecting some of our customers.

This is incident is currently being verified to ascertain impact.

Status and updates will continue here every 30 minutes until the incident has been resolved.

We apologise for this disruption to your service.