RQ Disruption - Multiple RQ Services

This incident has been resolved.

Resolved

Our Incident Management Team has confirmed everything is looking healthy. Largest impact was on Canadian clients however we did see timeouts in RQ for a subset of American clients, if you were experiencing issues during that time please reach out to our Support team to investigate further. We will continue to monitor but at this time we are resolving this incident.

Our team is continuing to monitor and investigate mitigation steps related to the Microsoft incident. The majority of impact appears to be for Canadian clients however may not be limited to them. We have currently not seen invoice impact for US Clients and will continue to monitor. Additional updates to follow.

Our team has implemented additional mitigation measures and is currently monitoring to see impact. More updates to follow.

After the failover we are still seeing timeouts but invoicing is showing improvement. Our team is continuing to work on mitigating the incident. More updates to follow.

Currently our Incident Management team is moving traffic to restore service. The issue has been identified as a Microsoft issue however we are attempting to failover to see if it will mitigate the impact. More updates to follow.

Currently we are seeing a service disruption related to multiple services within RQ. Our Incident Management Team has identified this may be related to a larger Microsoft outage that is currently on going. More updates to follow.