Outage in Fly.io

YYZ - application host failure

Resolved Minor
October 08, 2022 - Started about 3 years ago - Lasted about 7 hours
Official incident page

Incident Report

We are investigating a network connectivity issue affecting a server in the YYZ region.
Components affected
Fly.io YYZ - Toronto, Canada

Need to monitor Fly.io outages?

One place to monitor all your cloud vendors. Get instant alerts when an outage is detected.

Latest Updates ( sorted recent to last )
MONITORING about 3 years ago - at 10/09/2022 02:43AM

All applications have now been restarted on other working hosts, and we are monitoring the results.

IDENTIFIED about 3 years ago - at 10/09/2022 02:25AM

Applications without volumes have all been restarted on other hosts in the region.
The failed host can't be recovered quickly, so we're restoring volumes from their most recent daily snapshot and will restart them on another host. Recently-written data will be unavailable for volumes not in a multi-node cluster.

IDENTIFIED about 3 years ago - at 10/09/2022 12:29AM

We're working on replacing the failed boot drive, but don't have a firm ETA yet. We also identified an issue preventing applications from being restarted on other servers in the region and are working on a fix.

IDENTIFIED about 3 years ago - at 10/08/2022 10:50PM

There was a boot-drive failure on a host in the YYZ region, and the failed drive will need to be replaced. Applications without volumes will be restarted on other servers.

Volumes on the affected host may be unavailable until the host is fully restored. Volumes are stored on separate drives so we don't expect any customer data to be lost.

INVESTIGATING about 3 years ago - at 10/08/2022 10:14PM

We are investigating a network connectivity issue affecting a server in the YYZ region.

Latest Fly.io outages

Global network issues - 5 days ago
Logs/metrics issues - 11 days ago
TLS certificate issues - 11 days ago

The Status Page Aggregator Built for IT Teams

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 4522 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook