01 - Investigating

The issue in our North America Production Environment has been resolved as of ~3:45p EST on 2/14. Further details may be provided in a post-mortem report.

Our Engineering teams have stabilized the North America Production Environment issue as of February 14, 2025 at 11:56 AM EST and are continuing to monitor for stability.

Our Engineering teams have identified that the issue impacting our North America Production Environment is related to an Action Properties (previously Action Attributes) change during the last release. They have identified the root cause and are working on a fix to release as soon as possible.

Customers experiencing issues Pushing to Launchpad can work around this issue by opening and re-saving all Action Properties in the space. To do this,
1. Navigate to Orchestrate -> Action Properties.
2. Open each Action Property.
3. Click 'Save'.
4. Navigate to Test & Publish -> Recent Changes.
5. Select all the Action Properties.
6. Click 'Push To Launchpad'.
7. Navigate to Launchpad.
8. Click 'Publish'.
9. Navigate back to Recent Changes.
10. Select the changes you want to publish.
11. Click 'Push to Launchpad'.

Our Engineering teams have identified the issue in our North America Production Environment and are working on a resolution.

We are continuing to investigate this issue.

We are currently experiencing a partial outage across all MXO regions as of 12:20 PM EST. Our engineers are currently investigating the issue. We will send an additional update in 60 minutes or when more information is available.