S3 Object Storage – Intermittent Service Disruptions

We have made significant progress in restoring stability to our S3 Object Storage service.

The storage issue identified as the primary cause of the intermittent disruptions has now been resolved, and the affected portion of the storage cluster has returned to normal operation.

The cluster is continuing to recover from the earlier disk failure, and some background recovery operations remain ongoing.

Our team is closely monitoring service performance and working with our hardware vendor to address the remaining recovery and capacity concerns.

While we expect service stability to improve following this recovery, we are continuing to monitor for further disruptions before considering the incident fully resolved.

We will provide further updates as the situation progresses.

Since late last night, we have been experiencing intermittent disruptions to our S3 Object Storage service, which may result in requests timing out or failing.

The issue is occurring as our storage cluster continues to recover and rebalance data following a storage disk (OSD) failure.

Our team has been working around the clock to maintain service stability and minimise disruptions. We have engaged our hardware vendor's support team and are continuing to investigate the underlying cause and work towards a permanent resolution.

We are actively monitoring the service and taking steps to restore access when disruptions occur.

We will provide further updates as our investigation progresses.