Intermittent failures in performing some requests

Hello All

With the actions earlier today we are seeing positive results and our testing and telemetry is not showing an issue. We are moving forward cautiously and will progress the status to 'Monitoring'. NT-ware Support and Operations teams will continue to monitor and provide further updated early next week.

Kind Regards
uniFLOW Online Operations Team

Hello All

This notification is to inform you that there will be a brief outage of between 1-5 minutes. This outage will being at 7:50 UTC (2 minutes from the sending of this notification) and is necessary to further resolve this issue.

Sorry for the inconvenience.

Kind Regards
NT-ware uniFLOW Online Operations.

Hello All

Just a short update to keep you informed. We have established automated corrective actions and hope this results in as little interruption as possible to our customers. The investigation is ongoing between Microsoft and NT-ware with resources working hard on both sides.

While the deployment update took place on Friday we are continuing further post deployment steps as part of this case.

Thanks for your patience during this long and difficult case.

Kind Regards
NT-ware uniFLOW Online Operations Team

Hello Everyone,

We will be moving this issue up to identified at this time but we are still working with Microsoft on a Root Cause. The issues is presenting itself are a web resource failing to resource. However it only impacts one out of many web role depending on the time of day and load the system is automatically scaled for. We are also only seeing this on this one role in the US and not on our 8+ other deployments globally.

We can detect the issue very quickly and working to reduce the reaction time to minimize the impact to the field.

While this is looking very much like a Microsoft hardware / environment issues we cannot put our finger on it and will continue to investigation with Microsoft. We have a planned deployment update this Friday for the US. We will take this opportunity to re-deploy into a new environment within the maintenance window.

We greatly appreciate your patience during this investigation, Our Dev and Operations teams are actively working to reduce the impact in the field.

Kind Regards,
uniFLOW Online Operations Team

Dear all,

please note that the root cause analysis is ongoing between NT-ware and Microsoft. We have implemented a proven method of monitoring and detecting known symptoms at this stage, which allows us to mitigate the issue and keep any interruptions at a minimum. We apologize for the inconvenience caused and will keep you updated about any progress via this page.

Kind Regards
uniFLOW Online Operations Team

Hello All,

During our continued investigation we have found a potential cause for this incident. Measures have been put in place to mitigate the issue for now and we are monitoring further. So far, the results are positive and we will keep you posted about our next steps.

Kind Regards
uniFLOW Online Operations Team

Hello All

We are continuing to investigate this issue.

At this time we have monitoring and mitigation actions in place to reduce the impact to customers. Our teams are working with high priority on this problem and additionally raised support requests to Microsoft while we work to identify the root cause.

Further updates will be provided as information becomes available.

Kind Regards
uniFLOW Online Operations Team.

Hello All

Through our telemetry and field feedback we are seeing intermittent failures of some requests to our US deployment. This is only affecting a very small number of tenants and not a permanent condition.

Impact:
This can result in a resources or job lists not loading or presenting an error. In most cases performing the function a second time will resolve the problem.

The Operations team will continue to investigate this issue, we will provide an update as further information becomes available.


Regards,
uniFLOW Online Operations Team