Outage in Stellar.org

History lag and degraded performance on certain Horizon endpoints

Resolved Minor
March 11, 2024 - Started about 2 months ago - Lasted 7 days
Official incident page

Need to monitor Stellar.org outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Stellar.org, and never miss an outage again.
Start Free Trial

Outage Details

We've identified a high CPU utilization on SDF Horizon nodes due to increased request load that saturated DB connections.
Latest Updates ( sorted recent to last )
RESOLVED about 1 month ago - at 03/18/2024 11:01PM

Service has remained stable over the past week and thus the incident is resolved. Note that rate limits may dynamically adjust to preserve service health in times of high network activity or volatility.

MONITORING about 2 months ago - at 03/12/2024 06:53PM

Fix appears to have resolved performance issues, but reduced rate limits are still in effect as we continue to monitor.

MONITORING about 2 months ago - at 03/12/2024 12:29AM

A fix has been deployed. We are monitoring to ensure it is stable.

MONITORING about 2 months ago - at 03/12/2024 12:24AM

Additional reduction of rate limits.

MONITORING about 2 months ago - at 03/12/2024 12:22AM

Performance degradation observed again.

MONITORING about 2 months ago - at 03/12/2024 12:20AM

We flipped the standby and active endpoint. This temporarily fixed the problem.

MONITORING about 2 months ago - at 03/11/2024 11:45PM

Reports of degraded performance in Discord.

INVESTIGATING about 2 months ago - at 03/11/2024 11:37PM

We reduced global rate limits by half for Horizon.

INVESTIGATING about 2 months ago - at 03/11/2024 11:34PM

We've identified a high CPU utilization on SDF Horizon nodes due to increased request load that saturated DB connections.

The easiest way to monitor Stellar.org and all cloud vendors

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3153 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime