CircleCI's Smarter Testing feature experienced a 2.8-hour incident where customers were unable to run tests, with additional degradation to Dynamic Test Splitting and Dynamic Parallelism causing jobs to fall back to using all nodes. Impact analysis data updates were also delayed, resulting in broader-than-necessary test selection. Engineers performed emergency maintenance to resolve the issue, with full Smarter Testing functionality restored by 19:22 UTC.
Trusted by 1,000+ teams
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
Smarter Testing functionality is restored.
We appreciate your patience as we worked through this.
The maintenance was successful. Smarter Testing functionality has been restored.
We are monitoring to ensure performance remains stable.
At 18:45 UTC, we will perform emergency maintenance, which is expected to take a few minutes. During this window, test jobs for customers using Smarter Testing may be delayed or fail.
Thank you for your patience while our engineers work to resolve this.
We will provide another update by 19:05 UTC.
Since 17:55 UTC, test jobs for customers using Smarter Testing have been running again.
Dynamic Test Splitting is still not running optimally.
Dynamic Parallelism is also not running optimally, so jobs that use it should be expected to fall back to using all nodes.
Thank you for your patience while our engineers work to resolve this.
We will provide another update by 18:50 UTC
Since 17:55 UTC, test jobs for customers using Smarter Testing have been running again.
Dynamic Test Splitting is still not running optimally.
Dynamic Parallelism is also not running optimally, so jobs that use it should be expected to fall back to using all nodes.
Thank you for your patience while our engineers work to resolve this.
We will provide another update by 18:30 UTC.
Since 17:38 UTC, some test jobs for customers using Smarter Testing have been failing.
Thank you for your patience while our engineers work to resolve this.
Since 17:09 UTC, we have been seeing delays in updating test impact analysis data.
Test selection may be less precise, which may cause more tests than necessary to run. Thank you for your patience while our engineers work to resolve this.
Starting at 16:38 UTC, test jobs for customers using Smarter Testing should be back running. Dynamic Test Splitting may still not be working optimally for some customers.
Some Smarter Testing customers may not be able to run tests.
We are also seeing delays updating the impact analysis data map, which may cause more tests to be selected by Smarter Testing.
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with