[Germany] Delays in email delivery

Microsoft reports in EX1331830 that their configuration changes have reached approximately 50% of the affected infrastructure and message queues are steadily improving. This is also confirmed by our telemetry. More information can be found in the Microsoft 365 Admin Center under EX1331830 (https://admin.cloud.microsoft/#/servicehealth/:/alerts/EX1331830), if accessible.

CodeTwo is and has been operating normally throughout this incident. All emails were delivered with signatures attached.

As the issue is no longer affecting our mail flow and is not related to CodeTwo infrastructure, we are resolving it. Our teams will continue to monitor the situation 24/7/365.

Microsoft reports in EX1331830 that they are now evaluating targeted service infrastructure resets as a potential mitigation and they're collecting additional diagnostic data to determine the next steps.

We continue to observe stable mail flow performance in the Germany West Central region, with no delays in other regions.

All signatures are added correctly.

We’ll continue to monitor the situation and provide another update in 3 hours or sooner if anything changes.

Microsoft reports in EX1331830 that Exchange Online users may experience significant delays or failures when sending and receiving email messages in Exchange Online, with some messages remaining undelivered for over an hour. The impact is currently limited to users in North America and Germany (although we do not see these delays in North America). Microsoft is continuing to analyze the issue and determine next steps. This confirms this is not a CodeTwo infrastructure issue.

At the same time, we are observing a significant improvement in server-side mail processing performance in Germany for all CodeTwo users in this region. Queues are now nearly cleared. We continue to monitor the situation.

All signatures are added correctly.

Thank you for your patience. We’ll provide another update in 3 hours or sooner if anything changes.

We are seeing an improvement in message processing times. This is likely due to lower traffic levels during off-peak hours in Germany.
Microsoft continues to investigate the issue. At this time, the problem remains isolated to EOP servers located in the Frankfurt region.

Thank you for your patience. We’ll provide another update in 3 hours or sooner if anything changes.

We’re continuing to monitor the situation.

Email signatures are being appended correctly. However, delivery of messages with signatures is still delayed due to an issue with Microsoft Exchange Online Protection servers, which are experiencing degraded performance and are processing messages from our service slower than usual.

We can see that the issue is widespread in Germany. Other services that rely on the Exchange Online mail flow pipeline are experiencing similar delays in this region. Microsoft is currently working to resolve the problem, and we are actively monitoring their progress.

Thank you for your patience. We’ll provide another update in 90 minutes or sooner if anything changes.

We’ve confirmed that the delays are due to degraded availability of Exchange Online Protection in the Germany West Central region and are not related to CodeTwo.
We’ve contacted Microsoft and we’re actively monitoring the situation.

We're observing delays in email delivery in the Germany West Central region. We're investigating this right now. It looks like degraded performance of Exchange Online Protection (EOP).

Signatures are added normally.