Outage in Honeycomb

Querying Errors

Resolved Minor
September 28, 2022 - Started over 1 year ago - Lasted 2 days
Official incident page

Need to monitor Honeycomb outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Honeycomb, and never miss an outage again.
Start Free Trial

Outage Details

We are investigating elevated errors rates with queries for some customers.
Latest Updates ( sorted recent to last )
IDENTIFIED over 1 year ago - at 09/28/2022 10:27PM

We've confirmed that access to the data and query performance has been restored, but have blocked deployments to the affected service until we return to full capacity.

IDENTIFIED over 1 year ago - at 09/28/2022 07:57PM

We estimate it will take 2 hours for the cluster to catch up, after which the affected data will be fully restored. This affects a small subset of queries in certain datasets.

IDENTIFIED over 1 year ago - at 09/28/2022 07:47PM

The fix has been rolled out to ensure no other data partitions are affected, but we're mitigating the ripple effects of the initial cause before we can re-enable access to the affected data.

IDENTIFIED over 1 year ago - at 09/28/2022 06:47PM

The issue has been identified and a potential fix is being tested and rolled out to the fleet.

INVESTIGATING over 1 year ago - at 09/28/2022 06:05PM

We have restored querying, but customers may see some missing data from a subset of queries. We are actively working on restoring the ability to query that data.

INVESTIGATING over 1 year ago - at 09/28/2022 05:55PM

We are continuing to investigate, and are actively working to identify a fix.

INVESTIGATING over 1 year ago - at 09/28/2022 05:17PM

We are continuing to investigate, and are actively working to identify a fix.

INVESTIGATING over 1 year ago - at 09/28/2022 04:51PM

We are investigating elevated errors rates with queries for some customers.

Latest Honeycomb outages

Raw Row Query Failures - 20 days ago
eu1 ingest and UI down - 22 days ago
Login issues on SAML teams - about 2 months ago

Stay informed of vendor status updates

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3153 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime