Outage in PubNub

Issue with messages missing in Storage & Playback in US West PoP

Resolved Minor
May 03, 2022 - Started over 3 years ago - Lasted about 1 hour
Official incident page

Incident Report

Users in our US West PoP are currently experiencing an issue with our Storage & Playback service that is causing some messages to not appear in calls to that service. No errors are being returned from the service, despite messages not being returned correctly. The other services, including PubSub, are working normally. We are investigating the issue.
Components affected
PubNub Storage and Playback Service PubNub North America Points of Presence PubNub Southern Asia Points of Presence PubNub Asia Pacific Points of Presence

One place to monitor all your cloud vendors. Get instant alerts when an outage is detected.

Try IsDown risk-free 14-day free trial · No credit card required
Latest Updates ( sorted recent to last )
MONITORING over 3 years ago - at 05/03/2022 02:22PM

A fix has been implemented and we are monitoring the results.

IDENTIFIED over 3 years ago - at 05/03/2022 02:22PM

A workaround for Storage & Playback has been implemented. We are monitoring for additional issues as the downstream database provider works on the issue.

IDENTIFIED over 3 years ago - at 05/03/2022 01:51PM

Other PoPs have been seeing increased errors and latency for the past few minutes as they assist in the backlog from US West.

IDENTIFIED over 3 years ago - at 05/03/2022 01:45PM

The Storage & Playback service is degraded in the US West PoP due to a database issue at a downstream service provider. We are working to use resources in other PoPs to help US West.

INVESTIGATING over 3 years ago - at 05/03/2022 01:15PM

Users in our US West PoP are currently experiencing an issue with our Storage & Playback service that is causing some messages to not appear in calls to that service. No errors are being returned from the service, despite messages not being returned correctly. The other services, including PubSub, are working normally. We are investigating the issue.

Latest PubNub outages

Elevated latencies and errors for multiple services in US-west and US East - about 3 hours ago
Potential for some missed messages for subscribers in IAD - 3 days ago
Elevated Event & Action Error In FRA Region - 14 days ago
Increased Error Rate and Latency for Presence - about 1 month ago
Presence is experiencing elevated latencies and error rates - about 2 months ago

The Status Page Aggregator Built for IT Teams

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 4522 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook