Use cases
Software Products E-commerce MSPs Schools Development & Marketing DevOps Agencies Help Desk
Company
Internet Status Blog Pricing Log in Get started free

Outage in Firezone Production

Gateways failure to reconnect to control plane API

Resolved Minor
December 23, 2025 - Started 4 months ago - Lasted 2 days
Official incident page

Incident Report

At December 23, 3:50 PM UTC, we rolled a minor fix to our Entra authentication adapter out to production. Deploys to production are generally considered safe and are designed not to cause any packet loss or downtime for customers. Shortly after, at December 23, 4:10 PM UTC, we noticed a discrepancy in the number of nodes that successfully rejoined their control "channels" - that is, the message channel clients/gateways use to receive connection intents and configuration updates. These channels are separate from the actual WebSocket transport underlying them. The discrepancy here looks to have been very small, in the single-digit % of nodes. Upon noticing this discrepancy, we restarted API node services on each affected API node to trigger a full reset of the control plane WebSocket for these nodes. At or around December 23, 4:50 PM, UTC we verified all nodes were successfully reconnected, restoring full functionality.

Trusted by 1,000+ teams

Never miss outages in third-party dependencies

Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.

IsDown status aggregator dashboard
Latest Updates ( sorted recent to last )
RESOLVED 4 months ago - at 12/25/2025 01:04PM

At December 23, 3:50 PM UTC, we rolled a minor fix to our Entra authentication adapter out to production. Deploys to production are generally considered safe and are designed not to cause any packet loss or downtime for customers.

Shortly after, at December 23, 4:10 PM UTC, we noticed a discrepancy in the number of nodes that successfully rejoined their control "channels" - that is, the message channel clients/gateways use to receive connection intents and configuration updates. These channels are separate from the actual WebSocket transport underlying them. The discrepancy here looks to have been very small, in the single-digit % of nodes.

Upon noticing this discrepancy, we restarted API node services on each affected API node to trigger a full reset of the control plane WebSocket for these nodes.

At or around December 23, 4:50 PM, UTC we verified all nodes were successfully reconnected, restoring full functionality.

Never miss outages in third-party dependencies

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 6320 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook