Some users may experience multiple issues with their Microsoft Teams

Title: Some users may experience multiple issues with their Microsoft Teams

User impact: Users may experience multiple issues with their Microsoft Teams.

More info: Affected scenarios include, but aren't limited to the following:

Mitigated/improving:

- [Updated] Users logging in or unlocking their devices after some time may have missing messages. We believe that this symptom has been addressed.
- [Updated] Users may have been unable to load messages in channels and chats. We believe that this symptom has been addressed.
- [Updated] Users were unable to view or download their media (images, videos, audio, call recordings, code snippets). We believe that this symptom has been addressed.
- [Updated] Some users were experiencing delays sending and receiving chat messages. We believe this symptom has been largely addressed, though some users may still experience brief delays.
- [Updated] Anonymous users may be unable to join meetings. We’re seeing improvement in this area but some users may still be affected by this scenario.
- [Updated] Teams connectors for Power Automate/Power Apps were experiencing errors. We believe that this symptom has been addressed.
- [Updated] Call Recordings might take longer to appear in user's OneDrive for Business and SharePoint Online. This symptom has been addressed.

Still affected/undergoing further evaluation:

- Users may be unable to load previous Copilot history, or new history is not written
- Bots may be unable to download attachments
- Sending and receiving read receipt notifications may be delayed
- Users may experience issues resuming or rejoining meetings.
- Users within organizations leveraging an Information Barrier may experience issues joining meetings
- Users performing a cold boot may not be able to log into teams and will see an "oops" page

Current status: We’re seeing significant improvements with many of the Teams features affected by this incident as we continue to apply mitigations and optimize traffic. We’re evaluating the remaining impact scenarios and are developing fixes and workstreams to address all lingering impact associated with this event. Please see the “more info” section above for the latest information on each impact scenario.

We understand the impact an issue like this can have on your organization, and we appreciate your partnership and patience as we work to remediate this issue.

Scope of impact: This issue can potentially impact any Microsoft Teams user in the scenarios outlined in the More info section.

Start time: Friday, January 26, 2024, at 2:55 PM UTC.

Next update by: Saturday, January 27, 2024, at 2:30 AM UTC.

Title: Some users may experience multiple issues with their Microsoft Teams

User impact: Users may experience multiple issues with their Microsoft Teams.

More info: Affected scenarios include, but aren't limited to:

- Anonymous users may be unable to join calls or meetings
- Users within organizations leveraging an Information Barrier may experience issues joining meetings
- Users performing a cold boot may not be able to log into teams and will see an "oops" page
- Users logging in or unlocking their devices after some time may see missing messages
- Users may fail to load messages in channels and chats
- Users are unable to view or download their media (images, videos, audio, call recordings, code snippets)
- Some messages may experience delays being sent
- Call Recordings might take longer to appear in user's OneDrive for Business and SharePoint Online
- Users may be unable to load previous Copilot history, or new history is not written
- Bots may be unable to download attachments
- Sending and receiving read receipt notifications may be delayed
- Teams connectors for Power Automate/Power Apps may experiencing errors


Current status: We’re continuing to apply mitigations across the affected infrastructure and our telemetry is showing additional improvement in the user experience, though many customers are still affected by this issue. We’re also working to apply fixes to address individual affected Teams features in parallel while our broader remediation strategy is ongoing. We’re evaluating any and all additional workstreams that will allow us to reduce the impact to those customers that are still affected.

We understand the impact an issue like this can have on your organization, and we appreciate your partnership and patience as we work to remediate this issue.

Scope of impact: This issue can potentially impact any Microsoft Teams user in the scenarios outlined in the More info section.

Start time: Friday, January 26, 2024, at 2:55 PM UTC.

Next update by: Saturday, January 27, 2024, at 12:30 AM UTC.

Title: Some users may experience multiple issues with their Microsoft Teams

User impact: Users may experience multiple issues with their Microsoft Teams.

More info: Affected scenarios include, but aren't limited to:

- Users performing a cold boot may not able to log into teams and will see an "oops" page
- Users logging in or unlocking their devices after some time may see missing messages
- Users may fail to load messages in channels and chats
- Users are unable to view or download their media (images, videos, audio, call recordings, code snippets)
- Some messages may experience delays being sent
- Call Recordings might take longer to appear in user's OneDrive for Business and SharePoint Online
- Users may be unable to load previous Copilot history, or new history is not written
- Bots may be unable to download attachments
- Sending and receiving read receipt notifications may be delayed
- Anonymous users may be unable to join meetings
- Teams connectors for Power Automate/Power Apps may experiencing errors


Current status: Our network and backend service optimization efforts are ongoing and we’re monitoring internal telemetry to confirm that our efforts are effectively reducing the impact to customers. We’re continuing to scale up our services and identify new workstreams intended to remediate this problem more rapidly. Although many customers remain impacted by this issue, we’re seeing a reduction in errors and an increase in availability.

We understand the impact an issue like this can have on your organization, and we appreciate your partnership and patience as we work to remediate this issue.

Scope of impact: This issue can potentially impact any Microsoft Teams user in the scenarios outlined in the More info section.

Start time: Friday, January 26, 2024, at 2:55 PM UTC.

Next update by: Friday, January 26, 2024, at 11:00 PM UTC.

Title: Some users may experience multiple issues with their Microsoft Teams

User impact: Users may experience multiple issues with their Microsoft Teams.

More info: Affected scenarios include, but aren't limited to:
- Users performing a cold boot may not able to log into teams and will see an "oops" page
- Users logging in or unlocking their devices after some time may see missing messages
- Users may fail to load messages in channels and chats
- Users are unable to view or download their media (images, videos, audio, call recordings, code snippets)
- Some messages may experience delays being sent
- Call Recordings might take longer to appear in user's OneDrive for Business and SharePoint Online
- Users may be unable to load previous Copilot history, or new history is not written
- Bots may be unable to download attachments
- Sending and receiving read receipt notifications may be delayed
- Anonymous users may be unable to join meetings
- Teams connectors for Power Automate/Power Apps may experiencing errors

Current status: Our failover operation did not provide the immediate relief intended for end users in North and South America regions. However, we’re monitoring telemetry closely as we continue to optimize traffic patterns and apply configuration changes intended to reduce customer impact as quickly as possible. We understand the impact an issue like this can have on your organization, and we appreciate your partnership and patience as we work to remediate this issue.

Scope of impact: This issue can potentially impact any Microsoft Teams user in the scenarios outlined in the More info section.

Start time: Friday, January 26, 2024, at 2:55 PM UTC.

Next update by: Friday, January 26, 2024, at 10:00 PM UTC.

Title: Some users may experience multiple issues with their Microsoft Teams

User impact: Users may experience multiple issues with their Microsoft Teams.

More info: Affected scenarios include, but aren't limited to:

- Users performing a cold boot may not able to log into teams and will see an "oops" page
- Users logging in or unlocking their devices after some time may see missing messages
- Users may fail to load messages in channels and chats
- Users are unable to view or download their media (images, videos, audio, call recordings, code snippets)
- Some messages may experience delays being sent
- Call Recordings might take longer to appear in user's OneDrive for Business and SharePoint Online
- Users may be unable to load previous Copilot history, or new history is not written
- Bots may be unable to download attachments
- Sending and receiving read receipt notifications may be delayed
- Anonymous users may be unable to join meetings
- Teams connectors for Power Automate/Power Apps may experiencing errors

Current status: Our failover operation did not provide the anticipated relief to end users
in North and South America regions, and we are now working to optimize traffic patterns as part of the mitigation effort. We’re applying configuration changes across the affected network infrastructure to reduce customer impact as quickly as possible.

Scope of impact: This issue can potentially impact any Microsoft Teams user in the scenarios outlined in the More info section.

Start time: Friday, January 26, 2024, at 2:55 PM UTC

Next update by: Friday, January 26, 2024, at 9:00 PM UTC

Title: Some users may experience multiple issues with their Microsoft Teams

User impact: Users may experience multiple issues with their Microsoft Teams.

More info: Affected scenarios include, but aren't limited to:
- Users performing a cold boot may not able to log into teams and will see an "oops" page
- Users logging in or unlocking their devices after some time may see missing messages
- Users may fail to load messages in channels and chats
- Users are unable to view or download their media (images, videos, audio, call recordings, code snippets)
- Some messages may experience delays being sent
- Call Recordings might take longer to appear in user's OneDrive for Business and SharePoint Online
- Users may be unable to load previous Copilot history, or new history is not written
- Bots may be unable to download attachments
- Sending and receiving read receipt notifications may be delayed
- Anonymous users may be unable to join meetings
- Teams connectors for Power Automate/Power Apps may experiencing errors

Current status: We’ve completed the failover in the Europe, Middle East, and Africa (EMEA) region and telemetry is showing improvement. We’re continuing with the failover processes in the Americas, and are monitoring whilst these processes complete.

Scope of impact: This issue can potentially impact any Microsoft Teams user in the scenarios outlined in the More info section.

Start time: Friday, January 26, 2024, at 2:55 PM UTC

Next update by: Friday, January 26, 2024, at 8:00 PM UTC

As part of the failover process, we're currently scaling up the alternate infrastructure so that all the traffic can be distributed to the alternate infrastructure.

This quick update is designed to give the latest information on this issue.

Title: Some users may experience multiple issues with their Microsoft Teams

User impact: Users may experience multiple issues with their Microsoft Teams.

More info: Affected scenarios include, but aren't limited to:
- Users performing a cold boot may not able to log into teams and will see an "oops" page
- Users logging in or unlocking their devices after some time may see missing messages
- Users may fail to load messages in channels and chats
- Users are unable to view or download their media (images, videos, audio, call recordings, code snippets)
- Some messages may experience delays being sent
- Call Recordings might take longer to appear in user's OneDrive for Business and SharePoint Online
- Users may be unable to load previous Copilot history, or new history is not written
- Bots may be unable to download attachments
- Sending and receiving read receipt notifications may be delayed

Current status: We’ve identified that a portion of the Microsoft Teams service is experiencing a networking issue. We’re performing a failover to an alternate infrastructure to remediate impact and estimate this should take approximately an hour to complete.

Scope of impact: This issue can potentially impact any Microsoft Teams user in the scenarios outlined in the More info section.

Start time: Friday, January 26, 2024, at 2:55 PM UTC

Next update by: Friday, January 26, 2024, at 7:30 PM UTC

Whilst we're investigating the underlying cause of the issue, we're also reviewing the related monitoring alerts to determine all the different impacted features, and will update the 'More info' section to reflect these.

This quick update is designed to give the latest information on this issue.

Title: Some users may experience multiple issues with their Microsoft Teams

User impact: Users may experience multiple issues with their Microsoft Teams.

More info: Affected scenarios include, but aren't limited to:

- Users performing a cold boot may not able to log into teams and will see a "oops" page.
- Users logging in or unlocking their devices after some time may see missing messages.

Current status: Our review of service telemetry indicates a portion of database infrastructure that facilitates multiple APIs is experiencing a networking issue, resulting in impact. We're continuing our investigation to isolate the underlying cause of the networking issue and develop remediation actions.

Scope of impact: Impact is specific to users in North America or the Europe, Middle East, and Africa regions.

Next update by: Friday, January 26, 2024, at 6:30 PM UTC

Title: Some users may be experiencing multiple issues with their Microsoft Teams

User impact: Users may be experiencing multiple issues with their Microsoft Teams.

More info: Affected scenarios include, but aren't limited to:

- Users performing a cold boot may not able to log into teams and will see a "oops" page.
- Users logging in or unlocking their devices after some time may see missing messages.

Current status: We're reviewing service telemetry logs to determine the root cause of impact.

Scope of impact: Impact is specific to users who are being served through the affected infrastructure.

Next update by: Friday, January 26, 2024, at 6:00 PM UTC