Starting around 06:35 UTC on July 2, RudderStack experienced elevated delivery failures (HTTP 401 authentication errors) affecting a subset of Webhook destinations across both US and EU data processing pipelines, lasting approximately 7.3 hours. The root cause was a reset of header values in Webhook destination configurations, which broke authentication; event ingestion was unaffected throughout. A fix was deployed to restore header values automatically, the incident was resolved at 15:23 UTC, and workspaces with Data Retention enabled had their affected events replayed automatically.
Trusted by 1,000+ teams
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
This incident has been resolved. If your workspace have Data Retention enabled, we are going to replay the events automatically.
We have developed a fix for the authentication errors affecting delivery to some Webhook destinations, and we are now actively deploying it across affected customers. The remediation restores the reset header values automatically, so impacted destinations will resume delivery as the rollout reaches them.
We are continuing to work on a fix for this issue.
We are continuing to work on a fix for this issue.
Elevated delivery failures for Webhook destinations
We've identified the root cause of the delivery failures (authentication errors / HTTP 401) affecting some Webhook destinations. Event ingestion is unaffected — your data is being received and processed normally; only delivery to these destinations is impacted. Our engineering team is actively working on a fix and remediation is underway. We will post the next update as soon as recovery is confirmed.
Immediate fix on your side:
Open your Webhook destination settings in the dashboard, re-enter the keys/values in the Headers section (the previous values were reset), and save. Event delivery will resume right away.
We are investigating an increase in delivery failures (authentication errors) affecting a subset of Webhook destinations for some customers, beginning around 06:35 UTC on July 2. Event ingestion is not affected. We are actively investigating and will provide an update shortly.
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with