Iterable experienced a ~4.3-hour incident where user profile and event data updates were delayed across multiple clusters, causing downstream delays in segments and journeys; some bulk user update API requests also returned errors. The root cause was identified and a fix was rolled out cluster by cluster, with cluster 101 being the last to recover after working through its backlog. All clusters were fully restored with no data loss, and affected users were advised to retry any failed bulk update API requests.
Trusted by 1,000+ teams
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
The issue causing delays in processing user profile and event updates has been resolved, and normal processing has resumed across the affected clusters. No data loss was reported. If you received an error when submitting a bulk user update API request, please retry that request. We apologize for the disruption and appreciate your patience.
We have applied a fix, and processing has returned to normal on all affected clusters except cluster 101. Cluster 101 is now processing again and working through its backlog of delayed updates, which will be processed automatically. We will keep cluster 101 marked as degraded until it has fully caught up, and we will post another update by 10:30 PT or sooner.
Processing of user profile and event updates has returned to normal on all affected clusters except cluster 101. Updates on cluster 101 are still delayed, and our engineering team is working to restore normal processing there. Delayed updates on cluster 101 will be processed automatically once it catches up. We will post another update by 9:30 PT or sooner.
We have identified the cause of the processing delays and are rolling out a fix. Processing has already returned to normal on some affected clusters, and the remaining clusters are recovering as the fix is applied. Delayed updates will be processed automatically once each cluster has caught up. Some bulk user update API requests may have returned errors during this period; if you received errors, please retry those requests. We will post another update by 9:00 PT or sooner.
Starting around 14:00 UTC we started seeing delays in processing user profile and event updates for customers on some clusters. Data sent to Iterable is being accepted but is taking longer than usual to appear on user profiles, and segments and journeys that rely on that data may also be delayed. No data has been lost. Our engineering team is actively investigating, and we will post another update within 60 minutes.
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with