Elevated Latency/Degradation for US Live and Sandbox HTTP Proxy

We are currently investigating reports of elevated latency and degradation affecting the HTTP Proxy for both US Live and Sandbox environments. Our team is actively working to stabilize performance and restore full functionality. We will provide an update as soon as more information is available.

We identified and are actively monitoring an incident with Amazon Web Services (AWS) in the US, which is currently impacting the performance and availability of VGS services. Our team is working to implement a solution and restore normal operations as quickly as possible.

Our engineering team is executing a failover to a stable AWS environment to restore service. However, the widespread nature of the AWS incident is also impacting this failover process, and we are encountering issues. We are actively working to resolve these new complications.

Our engineering team has executed a failover to a stable AWS environment and we can confirm that reveal and dedupe operations are working fine. We are monitoring the issue on the AWS side and working on the resolution.

AWS is reporting the mitigation of the issue and we also see the early recovery for impacted services. Our team keeps monitoring this issue on our end.

Some of the services are having an improved performance, however we have a CNAME certificate issue right now. Because of the failover to a different region we have the certificates out of sync with the database. Our team is working on resolving this issue.

We have rolled back to the default AWS environment, and we can see that services are recovering now. We will continue monitoring the issue.