Unexpected Dashboard Alerting Outage

Our third party vendor has completed their recovery and is monitoring things as are we.

Alerts are working as expected and we closing monitoring the situation to ensure this continues.

If you have any additional questions, please contact support@redoxengine.com

Our third party vendor has completed their recovery and is monitoring things as are we.

Alerts are working as expected and we closing monitoring the situation to ensure this continues.

If you have any additional questions, please contact support@redoxengine.com

Our third-party vendor is in the process of recovering from an incident on their end. We are doing everything within our power on the Redox side to mitigate from our end. We will continue to provide updates as they become available and will have more information available on Monday.

Alerting within the customer dashboard will be inconsistent for now and through the weekend. We recommend reviewing any alerts with scrutiny to ensure they are accurate.

Our own Redox internal alerting and remains unimpacted. This includes automated destination level error retry and failure alerts.

The fix was deployed but we are still seeing intermittent errors on our end. We have been communicating with our 3rd party vendor to assist further. We will continue to provide updates as they become available.

The fix was deployed but we are still seeing intermittent errors on our end. We have been communicating with our 3rd party vendor to assist further. We will continue to provide updates as they become available.

We have identified the cause for the ongoing notification issue and are actively implementing a fix. We will update the status of this incident when this fix has been fully deployed.

A fix has been put in place for the dashboard so it now reflects current alert statuses as expected. We are continuing to work toward more reliable alert notification services.

We're continuing to investigate the root cause of the issue. It appears to be related to a third-party vendor. We are seeing degraded performance rather than an outage at this time. We are reaching out to this partner to assist with additional troubleshooting.

Additionally, we are taking steps to put failovers in place to ensure reliability of our dashboard alerts. A fix is also being put in place to ensure the dashboard still displays as expected.

Our automated monitoring tools detected a partial outage affecting the dashboard at ~2:00 PM Central. Intermittently, alert rules are unable to be loaded within the dashboard and a subset of alerts are not triggering as expected. Our team is currently investigating the cause and working on a solution.

Please work with your teams to implement downtime procedures. Traffic processing is not impacted.

If you have any additional questions, please notify us at support@redoxengine.com.