Optimizely experienced a 27-hour partial outage caused by an infrastructure issue that disrupted the data pipeline for Recommendations tracking and reporting across US and SE regions. While recommendations continued to be served throughout the incident, their quality was degraded and reporting data was incomplete. The pipeline backlog was cleared for both regions, with full resolution confirmed after reports finished catching up with accurate data.
Trusted by 1,000+ teams
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
This incident has been resolved.
For the US region, recommendations continue to be served, and they are being refreshed with the latest data, so quality should return to normal over the course of today. Reports may show incomplete numbers until they finish catching up. For the SE region, we consider this issue to be resolved. We will post another update today regarding the US cluster becoming fully operational.
We have fixed the cause. The data pipeline has now caught up in both regions. Recommendations continue to be served, and they are being refreshed with the latest data, so quality should return to normal over the course of today. Reports may show incomplete numbers until they finish catching up. We will post another update later today.
We have identified the cause. An infrastructure issue affected the data pipeline for some customer sites. Recommendations were still served, but their quality was reduced and reporting was impacted. We took the necessary actions and the Sweden region has finished processing its backlog. The US region is still catching up.
We are continuing to investigate this issue
We are investigating a partial outage affecting Recommendations tracking and reporting for some customer sites; recommendations continue to display, but learning and reporting are currently impacted.
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with