Outage in Tinybird
A significant fraction of Clickhouse replicas marked as unhealthy
Resolved Minor
July 28, 2026 - Started 11 days ago
- Lasted about 1 hour
Incident Report
Summary AI Generated
A significant fraction of Tinybird's ClickHouse database replicas were incorrectly marked as unhealthy due to an automatic Ubuntu package upgrade that triggered unexpected restarts of database services across multiple servers. This disrupted traffic distribution across healthy replicas, causing degraded performance and errors for some clusters over approximately 1.4 hours. The issue was resolved by manually marking the affected replicas as healthy, with the underlying package upgrade process identified as the root cause.
Some database replicas have been marked as unhealthy incorrectly. This is affecting how traffic is distributed among healthy replicas, and in some clusters it's resulting in degraded performance and some errors.
Trusted by 1,000+ teams
The Status Page Aggregator with Early Outage Detection
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
Latest Updates ( sorted recent to last )
MONITORING
11 days ago - at 07/28/2026 07:38AM
We have narrowed the root cause to an automatic Ubuntu package upgrade triggering the restart of our database services on many servers, and those being marked unhealthy as a result.
Service should be generally restored already.
MONITORING
11 days ago - at 07/28/2026 07:20AM
We've marked as healthy the database replicas that were incorrectly marked as unhealthy. We're confirming the cause and have a few suspects.
We keep monitoring the situation.
INVESTIGATING
11 days ago - at 07/28/2026 06:44AM
Some database replicas have been marked as unhealthy incorrectly. This is affecting how traffic is distributed among healthy replicas, and in some clusters it's resulting in degraded performance and some errors.
Latest Tinybird outages
Degradation on GCP europe-west2 public cluster - 1 day ago
Errors when creating and deleting replicas - 8 days ago
High error rate on GCP europe-west-3 - about 1 month ago
Degraded performance in the AWS us-east public cluster. - about 2 months ago
The Status Page Aggregator with Early Outage Detection
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with
