Outage in DigitalOcean

Latest AWS SDK/CLI updates incompatible with Spaces

Resolved Minor
January 16, 2025 - Started about 1 month ago - Lasted 5 days
Official incident page

Need to monitor DigitalOcean outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including DigitalOcean, and never miss an outage again.
Start Free Trial

Outage Details

DigitalOcean Spaces Customers using the latest versions (released on Jan 15, 2025) of the AWS CLI or any AWS SDK, or relying on a tool or application that depends on any of these versions of the AWS CLI or an AWS SDK, are experiencing failed uploads to Spaces buckets in all regions. This is caused by a change made by AWS on January 15, 2024 to the AWS CLI and almost all AWS SDKs (including boto3) to require use of “Data Integrity Protections for Amazon S3” (https://docs.aws.amazon.com/sdkref/latest/guide/feature-dataintegrity.html). The currently recommended solution is to downgrade (roll back) to a version of the AWS CLI or AWS SDK released prior to January 15, 2025, or to an earlier version of tools or applications that do not depend on one of these versions of the AWS CLI or AWS SDK. The list of known impacted AWS client tools are: AWS CLI v2.23.0 (workaround - move to last known good version: v2.22.35) AWS SDK for Python (boto3) v1.36.0 (workaround - move to last known good version: 1.35.99) AWS SDK for Go 2025-01-15 release (workaround - move to last known good release: 2025-01-14)
Components affected
DigitalOcean Global
Latest Updates ( sorted recent to last )
RESOLVED about 1 month ago - at 01/21/2025 10:21PM

Prior to Tuesday, January 21, 2025 at 19:20 UTC, customers that used an AWS CLI or AWS SDK version released on or after January 15, 2025 may have experienced issues with uploading files to a Spaces bucket. This impacted PutObject and UploadPart requests initiated by recent versions of the AWS CLI and AWS SDKs.

Our Engineering team has confirmed resolution of this issue for almost all Spaces buckets (including all new Spaces buckets), which are now compatible with the latest versions of the AWS CLI and AWS SDKs (and tools and applications that depend on these versions).

Note that Spaces does not currently verify data integrity checksums sent by the AWS CLI and AWS SDKs as part of upload requests (see Data Integrity Protections for Amazon S3 - https://docs.aws.amazon.com/sdkref/latest/guide/feature-dataintegrity.html).

Customers with a bucket that is still incompatible will receive an email from DigitalOcean with follow up steps. If you continue to experience problems, please open a ticket with our Support team. Thank you for your patience through this issue.

IDENTIFIED about 1 month ago - at 01/16/2025 07:14PM

DigitalOcean Spaces Customers using the latest versions (released on Jan 15, 2025) of the AWS CLI or any AWS SDK, or relying on a tool or application that depends on any of these versions of the AWS CLI or an AWS SDK, are experiencing failed uploads to Spaces buckets in all regions.

This is caused by a change made by AWS on January 15, 2024 to the AWS CLI and almost all AWS SDKs (including boto3) to require use of “Data Integrity Protections for Amazon S3” (https://docs.aws.amazon.com/sdkref/latest/guide/feature-dataintegrity.html).

The currently recommended solution is to downgrade (roll back) to a version of the AWS CLI or AWS SDK released prior to January 15, 2025, or to an earlier version of tools or applications that do not depend on one of these versions of the AWS CLI or AWS SDK. The list of known impacted AWS client tools are:
AWS CLI v2.23.0 (workaround - move to last known good version: v2.22.35)
AWS SDK for Python (boto3) v1.36.0 (workaround - move to last known good version: 1.35.99)
AWS SDK for Go 2025-01-15 release (workaround - move to last known good release: 2025-01-14)

Be the first to know when DigitalOcean and other third-party services go down

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3746 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook