Lob's data processing infrastructure fell behind, causing QR Code Engagement visualizations in the "Mail Analytics" and "Campaigns" dashboard sections to display incomplete data from March 16-24. While the dashboard reporting was affected, customers could still access their QR code scan data through direct API calls or existing webhook integrations, as no original scan data was lost. The issue was resolved through data backfilling completed on March 27, with additional monitoring improvements implemented to prevent future occurrences.
Trusted by 1000+ teams
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the moment something breaks.
Ready to take control?
Start Free TrialBackfills are complete. Additionally, Lob's engineering team has put improvements in place to prevent similar issues in the future, and updated our monitoring and alerting to catch similar issues if they do recur.
Please reach out to support@lob.com if you are still experiencing issues!
Our data processing infrastructure is running behind which is causing inaccuracies in the reporting tools.
Lob's QR Code Engagement visualizations in the "Mail Analytics" and "Campaigns" sections of the dashboard are missing some data that was created between Monday, March 16 and Tuesday, March 24.
Only the data processing system was impacted - no original QR code scan data has been lost. Customers can still access this data if they make a GET call to Lob's APIs, or if they have webhook ingestion already set up.
We've identified the issue and new scan events are now visible in the QR Code Engagement Chart. We are actively backfilling scans from the outage period that are missing from the chart. We've updated our anticipated date of resolution for completing this backfill - this should be complete no later than the evening of Friday, March 27.
Our data processing infrastructure is running behind which is causing inaccuracies in the reporting tools.
Lob's QR Code Engagement visualizations in the "Mail Analytics" and "Campaigns" sections of the dashboard are missing some data that was created between Monday, March 16 and today, March 24.
Only the data processing system was impacted - no original QR code scan data has been lost. Customers can still access this data if they make a GET call to Lob's APIs, or if they have webhook ingestion already set up.
We've identified the issue and are actively backfilling the QR Code Engagement Chart with the missing records. We anticipate completing this backfill no later than tomorrow morning - Wednesday, March 25.
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with