Google Cloud Storage Upload Issue affecting BigQuery Rivers

Since Google deployed a fix over 2 hours ago, we have not experienced any errors in rivers execution. As a result, we consider this incident resolved and are closing it.

Thank you for your understanding.

Rivery Support

Update: Issue Resolution
Google has implemented a fix to address the reported problem. Since the fix implementation, we have not observed any recurrence of the errors.

Our team is actively monitoring the situation to ensure the stability and reliability of the data processing pipelines. We are committed to preventing any further failures and will continue to provide updates as needed.

We appreciate your patience and understanding throughout this process.

Thank you
Rivery support Team

We received the following update from Google: The product team has rolled out a mitigation for the issue, and the rollout is currently in progress.
The ETA for completion is roughly 6 hours from now.

We will let you know as soon as the rollout is complete on this page.

Thank you
Rivery Support team

We have received confirmation from Google that the problem lies on their end.
Google is actively investigating, and updates can be monitored on their status page : https://support.cloud.google.com/portal/system-status

We will continue to monitor Google's status page, and will share update on any change we identify

Thank you
Rivery's support team

Incident Summary:
We are currently facing disruptions in our data processing pipelines, leading to failed rivers with Google BigQuery (BQ) as the target.
The error message indicates a problem with uploading to Google Cloud Storage (GCS), specifically reporting an HttpError 503 "Service Unavailable"

Impact:
The issue is affecting multiple rivers with diverse sources, all directed towards BigQuery. Consequently, data processing and loading into BigQuery are currently impacted.

Current Status:
Our engineering team is actively investigating the root cause of this issue. We are diligently working to determine whether the problem originates from Rivery or is a result of a failure in Google Cloud Storage.
We understand the critical nature of this problem and are committed to identifying and resolving the underlying issue.

We apologize for any inconvenience caused by this disruption.
Our team is dedicated to resolving the issue promptly. Thank you for your patience and understanding.