Latencies across multiple Azure DevOps services

Starting at approximately 00:21 UTC on 25 April 2024, we identified an issue with multiple Azure DevOps experiences impacting multiple geographies. We have applied mitigation and have noticed positive progress that it is improving availability for our customers. We are continuing to monitor our services to ensure the issue is fully mitigated. The primary impacts have been failures and slowness with Personal Access Token (PAT) usage and Azure Pipelines jobs failing to start or run jobs. Database performance in a service responsible for generating and authenticating tokens, including Personal Access Tokens and Pipeline session tokens, was identified as the underlying problem. We will continue to post updates as we learn more.