Datto SaaS Protection - M365 Teams Backup Failures

This incident has been resolved.

A hotfix deployed this week has eliminated the Microsoft Teams API throttling errors across the fleet, and the queue of backlogged incremental backup runs have been processed.

Our team is continuing to monitor backup performance, but the Teams backup success rates have now returned to normal levels.

We are continuing to monitor for any further issues.

Our Engineering team has finished the deployment of a hotfix that we believe will start reducing throttling errors, and we are actively monitoring it.

As a reminder from the last update, the queue of backups in our system that built up from the throttling errors still needs to be actioned on. This may cause backup runs to occur at a slower rate as we work through the backlog. It is expected that, although attempts may occur at a slightly lower rate, the success rate of these backup attempts will increase.

Our team is continuing to monitor backups and work on additional adjustments to improve the situation.

We are currently aware of a problem where Teams backup runs may fail with error "TooManyRequestsError"

SaaS Protection was recently forced to change the API endpoints used for Teams messages backup, due to the EWS API methods being deprecated. Since switching APIs, we have encountered a large amount of throttling errors (as noted above). This has been escalated to the highest levels and we currently have an ‘all hands on deck’ approach to find a solution that works around these throttling processes.

Currently, we do not have an ETA on when a fix will be available.

For detailed and current information, please follow https://community.datto.com/t5/Known-Issues-Workarounds/M365-Teams-Backup-Failures-Datto-SaaS-Protection/ba-p/103414