Outage in Railway

We're investigating failing connections on tcp-proxy to newly redeployed services

Resolved Minor
January 12, 2024 - Started almost 2 years ago - Lasted about 1 hour

Incident Report

We've isolated the issue down to a problem with route propagation on deploy. A subset of proxies don't receive the new route update, and thus were leading to partial failures as we load-balanced requests. We're temporarily mitigating the issue by clearing route caches periodically - full fix is on the way.
Components affected
Railway Routing Layer
The Status Page Aggregator Built for IT Teams

One place to monitor all your cloud vendors. Get instant alerts when an outage is detected.

Try IsDown risk-free 14-day free trial · No credit card required
Latest Updates ( sorted recent to last )
INVESTIGATING almost 2 years ago - at 01/13/2024 12:20AM

We've isolated the issue down to a problem with route propagation on deploy. A subset of proxies don't receive the new route update, and thus were leading to partial failures as we load-balanced requests. We're temporarily mitigating the issue by clearing route caches periodically - full fix is on the way.

IDENTIFIED almost 2 years ago - at 01/13/2024 12:49AM

We've identified the change that caused this and are testing the revert.

The Status Page Aggregator Built for IT Teams

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 4522 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook