Mux Outage History

Mux Data experienced elevated errors in historical metrics starting at approximately 22:08 UTC, affecting users' ability to access historical data analytics. The engineering team identified the root cause and implemented a fix within about 1.2 hours. The incident was fully resolved by 23:41 UTC after monitoring confirmed the fix was successful.

Mux Video experienced elevated rebuffering rates and playback failures affecting both VOD and Live video services for 1.8 hours. The issue impacted video playback quality and reliability across the platform. The problem was identified, a fix was implemented and monitored, and the incident was fully resolved.

Mux experienced elevated rebuffering and startup times affecting some on-demand video assets and live streams for 2.1 hours. The issue impacted both Mux Video VOD and Live services, causing degraded playback performance for users. The problem was identified, fixed, and resolved after monitoring confirmed the solution was effective.

Mux Data experienced delayed views for EU customers starting at 22:53 UTC, affecting the Data Collection component. The issue was identified and fixed, with the pipeline latency resolved and caught up by 1:50 UTC, and the incident was fully resolved after 3.3 hours.

Mux experienced data pipeline latency affecting EU customers from 15:50-16:04 UTC, causing inaccurate monitoring data and delayed views in both Monitoring and Historical interfaces. The Mux Data - Data Collection component was impacted, but no data was lost during the incident. The issue was resolved after 1.5 hours of investigation and monitoring.

Mux experienced issues with MP4 asset downloads affecting a small percentage of static rendition downloads across both VOD and Live video services. The incident impacted Mux Video components for 7.8 hours before being resolved. A fix was implemented and monitored before the issue was fully resolved.

Mux experienced a major incident where users encountered increased startup times, re-buffering, and playback errors due to 429 errors affecting both live streams and video-on-demand assets. The issue impacted Mux Video's VOD and Live components for 1.7 hours before being resolved with an implemented fix.

Mux experienced processing delays affecting some video assets across both VOD and Live services for 6.5 hours. The delays impacted asset ingestion as well as the generation of static renditions, masters, and captions. The issue was identified and resolved with a fix implementation, followed by monitoring to ensure stability.

The Mux Dashboard at dashboard.mux.com was unavailable for 1.5 hours, displaying exceptions when users attempted to load the page. All other Mux Data and Video services remained operational during the incident. The issue was resolved after implementing a fix and monitoring its effectiveness.

A recent encoding change caused video clips created in the last 24 hours to lose their audio due to initialization metadata mismatches, specifically affecting clips from assets created before March 6, 15:11 UTC that used "basic" or "premium" video quality settings. The issue impacted Mux Video VOD service for 3.1 hours before engineers resolved the underlying problem. New clips now function correctly, but affected clips created during the incident require recreation from the original assets as they cannot be retroactively fixed.