Outage in Kustomer

Timelines and API not returning data in Prod 1

Resolved Major
July 27, 2023 - Started over 1 year ago - Lasted about 22 hours
Official incident page

Need to monitor Kustomer outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Kustomer, and never miss an outage again.
Start Free Trial

Outage Details

Kustomer is investigating an event affecting Timelines and the API that may cause errors when loading the app in Prod1. Our team is investigating this issue. Please expect further updates within 30 Minutes and reach out to support at support@kustomer.com if you have additional questions or concerns.
Latest Updates ( sorted recent to last )
RESOLVED over 1 year ago - at 07/28/2023 01:47PM

While we are still investigating some minor issues, all access to the Kustomer platform has been restored. For any questions related to this incident, please reach out to Kustomer Support via Chat or at support@kustomer.com

MONITORING over 1 year ago - at 07/28/2023 12:38PM

Our engineers are continuing to ensure efficient cleanup efforts and are working closely to ensure precision in our execution.

MONITORING over 1 year ago - at 07/28/2023 09:25AM

Data integrity checks and clean-up efforts are still continuing in the background. Please expect further updates and reach out to Support at support@kustomer.com if you have additional questions or concerns.

MONITORING over 1 year ago - at 07/28/2023 06:45AM

Issues related to timelines, searches, and other areas in the platform are now resolved. Data integrity checks and clean up efforts will continue in the background.

MONITORING over 1 year ago - at 07/28/2023 03:18AM

The Kustomer team is continuing to resolve errors related to timelines, searches, and other areas of the platform, resulting from an extended event that impacted the platform. Affected data is being identified, grouped, checked against our database, restored and re-driven or reimported where needed.

MONITORING over 1 year ago - at 07/28/2023 02:02AM

An issue affecting Kustomer's ability to receive and display data has been resolved, and is being monitored. Errors may still be encountered as our team works to reimport data affected during the incident. Please look for the next update within an hour.

MONITORING over 1 year ago - at 07/28/2023 01:02AM

All channels and systems have been restored to full functionality. As we monitor the this resolution, errors may still continue to present in various areas, including timelines, searches, and workflows. Our team is working to clean up these remaining residual issues as we reimport data affected during the incident. Please look for additional updates within the next hour.

IDENTIFIED over 1 year ago - at 07/28/2023 12:03AM

As recovery of channels is underway and eventually completes, we do expect some errors to appear in timelines, searches, and workflows. We expect those errors to resolve when the clean-up of data during the period of outage fully completes. That clean up will be prioritized once the backlog of data has been processed and the system maintains stability.

IDENTIFIED over 1 year ago - at 07/27/2023 11:06PM

Timelines and searches are loading as expected. Our team is starting to turn channels back on. Please expect further updates in 1 hour

IDENTIFIED over 1 year ago - at 07/27/2023 10:07PM

Timelines and searches are loading more consistently. However, they are still in recovery. As systems scale we expect improvements. Please expect further updates within 1 hour.

IDENTIFIED over 1 year ago - at 07/27/2023 09:04PM

Timelines and searches are starting to load more consistently. Please expect further updates within 1 hour.

IDENTIFIED over 1 year ago - at 07/27/2023 08:00PM

Our team is currently scaling services to meet request traffic within the web app to resolve continued issues connecting to customer timelines and loading searches. Please expect further updates within 1 hour

IDENTIFIED over 1 year ago - at 07/27/2023 07:01PM

Our team is currently working on restoring connectivity to timelines and re-indexing searches with the latest updates. Upon completion, we will restore channel connections. Please expect further updates within 1 hour.

IDENTIFIED over 1 year ago - at 07/27/2023 06:04PM

Engineering is currently taking measures to restore connectivity in prod1. Channels have been temporarily turned off to prioritize the recovery of the affected system. There is currently no ETA yet for recovery, and will provide one as soon as possible. Please expect further updates within 1 hour

IDENTIFIED over 1 year ago - at 07/27/2023 05:50PM

Engineering is currently taking measures to restore connectivity in prod1. Channels have been temporarily turned off to prioritize the recovery of the affected system. There is currently no ETA yet for recovery but will provide one as soon as possible. Please expect further updates within 1 hour

IDENTIFIED over 1 year ago - at 07/27/2023 05:11PM

The engineering team has identified the issue affecting the connectivity to the platform and are working towards recovery. Please expect further updates within 30 minutes and reach out to support@kustomer.com if you have any questions.

IDENTIFIED over 1 year ago - at 07/27/2023 04:40PM

Our team is continuing to work to resolve the issue with timelines not loading and the API not returning data. Please expect further updates within 30 minutes and reach out to support@kustomer.com if you have any questions.

IDENTIFIED over 1 year ago - at 07/27/2023 04:08PM

Kustomer is aware of an event affecting Timelines and API that may cause errors when loading customer timelines within the platform. Our team is currently working to implement a resolution. Please expect further updates within 30 minutes and reach out to support at support@kustomer.com if you have additional questions or concerns.

INVESTIGATING over 1 year ago - at 07/27/2023 03:53PM

We are continuing to investigate this issue.

INVESTIGATING over 1 year ago - at 07/27/2023 03:44PM

Kustomer is investigating an event affecting Timelines and the API that may cause errors when loading the app in Prod1. Our team is investigating this issue. Please expect further updates within 30 Minutes and reach out to support at support@kustomer.com if you have additional questions or concerns.

Need to know when vendors go down? You’re in the right place

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3278 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime