Outage in Treasure Data

[All Regions] Elevated error rate for CDP KVS

Resolved Major
November 13, 2024 - Started about 1 month ago - Lasted about 3 hours
Official incident page

Need to monitor Treasure Data outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Treasure Data, and never miss an outage again.
Start Free Trial

Outage Details

Since approximately 4:00 UTC, we have been experiencing an issue with requests to CDP KVS, which may be affecting Profiles API functionality, causing delays in KVS data synchronization and updates to real-time segment information. Our team is actively investigating and working to resolve the issue as quickly as possible. Please note that Realtime 2.0 is not affected.
Latest Updates ( sorted recent to last )
RESOLVED about 1 month ago - at 11/13/2024 10:16AM

We would like to inform you that the issue has been fully resolved.

Incident Impact Details:
- Profiles API experienced an increased frequency of errors and timeouts.
- The latest logs were not reflected in real-time segments.

Incident Impact Time by Region:
us:
- Start: November 13, 04:14 UTC
- End: November 13, 08:55 UTC

aws-tokyo:
- Start: November 13, 04:14 UTC
- End: November 13, 08:54 UTC

eu01:
- Start: November 13, 04:17 UTC
- End: November 13, 08:51 UTC

ap02
- Start: November 13, 04:15 UTC
- End: November 13, 09:01 UTC

ap03
- Start: November 13, 04:17 UTC
- End: November 13, 08:52 UTC

We apologize for any inconvenience this may have caused and thank you for your patience and understanding.

MONITORING about 1 month ago - at 11/13/2024 09:17AM

Through our investigation, we identified the cause of the issue as a recent release operation. We have reverted all changes from this release, and normal functionality has been restored. Our team is closely monitoring the system to ensure continued stability.

INVESTIGATING about 1 month ago - at 11/13/2024 07:09AM

Since approximately 4:00 UTC, we have been experiencing an issue with requests to CDP KVS, which may be affecting Profiles API functionality, causing delays in KVS data synchronization and updates to real-time segment information. Our team is actively investigating and working to resolve the issue as quickly as possible.

Please note that Realtime 2.0 is not affected.

Be the first to know when Treasure Data and other third-party services go down

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3278 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime