Outage in Dataform

Increase in number of runs failing due to timeouts

Resolved Minor

October 23, 2019 - Started over 6 years ago - Lasted over 2 years
Official incident page

Incident Report

Since around 6PM GMT yesterday (2019-10-22) we experienced an increased number of run failures that manifested themselves as timeouts. These failed runs weren't actually timing out but had failed mid execution due to a crashing server. A fix for the issue was pushed today (2019-1023) at around 1245PM GMT, to handle errors thrown from Postgres based connections in a more orderly way, which we are now monitoring.

Need to monitor Dataform outages?

Monitor all your external dependencies in one place
Get instant alerts when outages are detected
Be the first to know if service is down
Show real-time status on private or public status page
Keep your team informed

Start monitoring for free

Latest Updates ( sorted recent to last )

RESOLVED over 6 years ago - at 10/23/2019 06:48PM

This incident has been resolved.

MONITORING over 6 years ago - at 10/23/2019 04:54PM

Correction: this issue has been around for longer than we initially realised, first occurrences were on the 2019-10-15 at around 5PM GMT.

MONITORING over 6 years ago - at 10/23/2019 01:17PM

Since around 6PM GMT yesterday (2019-10-22) we experienced an increased number of run failures that manifested themselves as timeouts. These failed runs weren't actually timing out but had failed mid execution due to a crashing server.

A fix for the issue was pushed today (2019-1023) at around 1245PM GMT, to handle errors thrown from Postgres based connections in a more orderly way, which we are now monitoring.

Latest Dataform outages

Partial scheduling failures - over 5 years ago

Some run log entries are missing or do not load - over 5 years ago

Partial outage on Dataform Web - over 5 years ago

Issues installing packages in Dataform due to NPM outage - over 5 years ago

Dataform server instability - over 5 years ago

Never miss outages in third-party dependencies

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 6020 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook