Function deployment failures at 35-40% in az-eastus-1

Cognite will be placing this incident in monitoring status. Investigation has shifted to an issue with Microsofts AZ-EASTUS-1. It appears a vnet was deployed by Microsoft last week and was not available to it's customers.

Cognite continues to work on this issue affecting function deployments. Currently, there is a hypothesis around deploying functions to entra virtual networks. We will provide updates as soon as progress is made.

We've noticed there are frequent function deployments failing in az-eastus-1 and we are investigating the issue. Due to the technically of the situation we are awaiting more information from relevant parties, and have paused the incident as we don't see any clear backend issues.

Our engineering team oncall was unable to renew the certificate at the time as he was not at home or in the office. We are hopeful that the cert will be renewed as soon as possible.

Cognite has discovered a certificate that has expired that is impacting az-eastus-1 customers. More info to come as we work to renew the cert.

Currently doing triage on the API issue with incident commander.

Customers are seeing 35-40% of function deployments failing. Possible correlation to an issue with the files api returning large amounts of 429 codes.