Honeycomb's activity log for the US instance experienced delays exceeding one hour due to a MySQL replica failover, affecting the logging of user activities and query runs. The service required backfilling of approximately 2.5 hours of data, with all activity log streams eventually catching up except for the query runs table which needed additional time for complete data recovery. The incident was fully resolved after monitoring confirmed all systems were operating normally.
Trusted by 1,000+ teams
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
This incident has been resolved.
Activity Log recovered at 07:00 UTC-07:00 today (about 6.5h ago). All streams are caught up.
All activity log streams are now caught up, except for the query runs table, which should have all data since the start of the incident backfilled by 1600 PDT.
We are continuing to monitor for any further issues.
We believe that the activity log should now be caught up.
Backfilling of the past 2h30m of data is now in progress and should complete shortly.
Activity log delay is rising, and is more than an hour behind due to a MySQL replica failover. Estimated recovery by 04:00 PDT.
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with