Outage in Census

Mirror Syncs Failing with SQL error

Resolved Minor
March 26, 2025 - Started about 1 month ago - Lasted 38 minutes
Official incident page

Need to monitor Census outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Census, and never miss an outage again.
Start Free Trial

Outage Details

We have identified a bug that is causing "mirror" syncs to fail with an error in the SQL generated by Census; the error message varies by data warehouse, but relates to a missing column. We are rolling back the incorrect deployment. Note that this is unrelated to the scheduled maintenance for Census Store, which has not yet started and will be postponed until this issue is resolved.
Components affected
Census Sync Engine
Latest Updates ( sorted recent to last )
RESOLVED about 1 month ago - at 03/26/2025 04:25AM

This incident has been resolved.

MONITORING about 1 month ago - at 03/26/2025 04:15AM

We have reverted to the previous working version of the system and sync success rates have returned to normal levels. We are investigating why our integration tests were insufficient to prevent this issue.

INVESTIGATING about 1 month ago - at 03/26/2025 04:03AM

We have identified a bug that is causing "mirror" syncs to fail with an error in the SQL generated by Census; the error message varies by data warehouse, but relates to a missing column. We are rolling back the incorrect deployment.

Note that this is unrelated to the scheduled maintenance for Census Store, which has not yet started and will be postponed until this issue is resolved.

Latest Census outages

Background job delays (Syncs not impacted) - 15 days ago
Sync might be failing with mismatch errors - 27 days ago
New SaaS Dataset, CSV Dataset, and ER Dataset creation unavailable for some customers - about 1 month ago
Some syncs failing with "Missing corresponding dataset file for prefix: record_deletes.0" - 3 months ago
IP Address Change for Database Requests - 3 months ago

Real-time vendor status monitoring for IT and Ops teams

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3970 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook