Outage in Railway

We're investigating failing connections on tcp-proxy to newly redeployed services

Resolved Minor
January 13, 2024 - Started almost 2 years ago - Lasted about 1 hour

Incident Report

We've isolated the issue down to a problem with route propagation on deploy. A subset of proxies don't receive the new route update, and thus were leading to partial failures as we load-balanced requests. We're temporarily mitigating the issue by clearing route caches periodically - full fix is on the way.
Components affected
Railway Routing Layer

Need to monitor Railway outages?

One place to monitor all your cloud vendors. Get instant alerts when an outage is detected.

Latest Updates ( sorted recent to last )
INVESTIGATING almost 2 years ago - at 01/13/2024 12:20AM

We've isolated the issue down to a problem with route propagation on deploy. A subset of proxies don't receive the new route update, and thus were leading to partial failures as we load-balanced requests. We're temporarily mitigating the issue by clearing route caches periodically - full fix is on the way.

IDENTIFIED almost 2 years ago - at 01/13/2024 12:49AM

We've identified the change that caused this and are testing the revert.

Status Aggregator for All Your Third-Party Services

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 4600 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook