Outage in Buildkite

Degraded performance

Resolved Minor
January 06, 2025 - Started 4 months ago - Lasted about 14 hours
Official incident page

Need to monitor Buildkite outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Buildkite, and never miss an outage again.
Start Free Trial

Outage Details

We are currently investigating this issue.
Latest Updates ( sorted recent to last )
RESOLVED 4 months ago - at 01/07/2025 07:33AM

We have completed our mitigation efforts, and have seen a full restoration of service for all users. Our monitoring shows that all customers are now operational and processing normally.

IDENTIFIED 4 months ago - at 01/07/2025 06:10AM

The majority of customers are now operational and processing normally. Remaining customers experiencing issues are having targeted mitigations applied.

IDENTIFIED 4 months ago - at 01/07/2025 04:02AM

The majority of customers are now operational and processing normally. Remaining customers experiencing issues are having targeted mitigations applied.

IDENTIFIED 4 months ago - at 01/07/2025 02:48AM

We continue to see the majority of customers see improvements as jobs are picked up and ran. We are implementing a further mitigation for the remaining impacted customers.

INVESTIGATING 4 months ago - at 01/07/2025 01:55AM

We continue to see the majority of customers see improvements as jobs are picked up and ran. We are investigating means to expand these mitigations to all customers.

INVESTIGATING 4 months ago - at 01/07/2025 12:44AM

We are continuing to see a restoration of services for the majority of our customers.

INVESTIGATING 4 months ago - at 01/07/2025 12:08AM

We’re seeing a partial restoration of services for majority of our customers.

INVESTIGATING 4 months ago - at 01/06/2025 11:48PM

We are still experiencing significant performance degradation to a database cluster. We are performing targeted load shedding to help restore service to broader customer base, before bringing the specific customers online.

INVESTIGATING 4 months ago - at 01/06/2025 11:12PM

We are still experiencing significant database degradation due to load. We are investigating multiple paths to try and resolve the issue.

INVESTIGATING 4 months ago - at 01/06/2025 10:12PM

We are currently experiencing significant database degradation and are continuing to investigate the issue.

INVESTIGATING 4 months ago - at 01/06/2025 09:42PM

The fix rolled out fixed the notification latency but we have run into another issue during this mitigation which the team is actively investigating.

MONITORING 4 months ago - at 01/06/2025 08:53PM

We've identified the cause of delayed notification delivery, a fix is in place and notification latency is recovering

IDENTIFIED 4 months ago - at 01/06/2025 07:46PM

We identified the possible root cause of the issue and are actively working on mitigating the issue

INVESTIGATING 4 months ago - at 01/06/2025 07:04PM

We are currently experiencing degraded performance due to a recurrence of recent database performance issues. Our engineering team is actively investigating and working on mitigating the impact

INVESTIGATING 4 months ago - at 01/06/2025 06:11PM

We are continuing to investigate this issue

INVESTIGATING 4 months ago - at 01/06/2025 05:55PM

We are currently investigating this issue.

All Your Service Status Pages in One Dashboard

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 4000 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook