Outage in Honeycomb

DNS Configuration Issue

Resolved Minor
November 30, 2023 - Started almost 2 years ago - Lasted 25 minutes
Official incident page

Incident Report

In an attempt to make our DNS mechanism better and safer, we deployed a change that instead appears to have drastically dropped our ability to do DNS lookups. While we don’t have a full understanding of how that happened, we have rolled back the change and everything is back to functional. For about 12 minutes, all services were disrupted, particularly those involving queries for data. This includes triggers, and some level of our ingestion as well.
Components affected
Honeycomb api.honeycomb.io - Event Ingest Honeycomb ui.honeycomb.io - Querying Honeycomb ui.honeycomb.io - App Interface

Need to monitor Honeycomb outages?

One place to monitor all your cloud vendors. Get instant alerts when an outage is detected.

Try IsDown risk-free 14-day free trial · No credit card required
Latest Updates ( sorted recent to last )
RESOLVED almost 2 years ago - at 11/30/2023 08:15PM

All systems now confirmed operational

MONITORING almost 2 years ago - at 11/30/2023 08:03PM

In an attempt to make our DNS mechanism better and safer, we deployed a change that instead appears to have drastically dropped our ability to do DNS lookups.
While we don’t have a full understanding of how that happened, we have rolled back the change and everything is back to functional.
For about 12 minutes, all services were disrupted, particularly those involving queries for data. This includes triggers, and some level of our ingestion as well.

Latest Honeycomb outages

aws-service-degradation - 1 day ago
Delays in SLO, Service Maps processing - 1 day ago
Investigating Querying Issues - 1 day ago
Partially Degraded Honeycomb Intelligence Features - 13 days ago
ServiceMaps down due to issues with an upstream provider - 27 days ago

The Status Page Aggregator Built for IT Teams

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 4522 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook