Outage in Harness
Deployment Degradation - Slowness in Prod3
Resolved MajorIncident Report
Summary AI Generated
Harness experienced a major service degradation lasting 4.9 hours that affected multiple components including Continuous Delivery, CI/CD pipelines, Cloud Cost Management, and other platform services due to elevated queue depth and throughput saturation on the MongoDB layer. The root cause was identified as database processing latency, which caused slowness in deployment executions and UI updates, though executions continued to function. The issue was resolved by implementing optimizations to restore database stability and normal processing speeds.
We are currently investigating this issue.
Components affected
Harness Continuous Delivery (CD) - FirstGen - EOS Harness Continuous Delivery - Next Generation (CDNG) Harness Cloud Cost Management (CCM) Harness Continuous Error Tracking (CET) Harness Continuous Integration Enterprise(CIE) - Self Hosted Runners Harness Continuous Integration Enterprise(CIE) - Mac Cloud Builds Harness Continuous Integration Enterprise(CIE) - Windows Cloud Builds Harness Continuous Integration Enterprise(CIE) - Linux Cloud Builds Harness Custom Dashboards Harness Feature Flags (FF) Harness Security Testing Orchestration (STO) Harness Service Reliability Management (SRM) Harness Chaos Engineering Harness Internal Developer Portal (IDP) Harness Infrastructure as Code Management (IaCM) Harness Software Supply Chain Assurance (SSCA)Trusted by 1,000+ teams
The Status Page Aggregator with Early Outage Detection
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
Latest Updates ( sorted recent to last )
RESOLVED
about 1 month ago - at 05/07/2026 12:54PM
This incident has been resolved.
MONITORING
about 1 month ago - at 05/07/2026 12:12PM
We are continuing to monitor for any further issues.
MONITORING
about 1 month ago - at 05/07/2026 12:12PM
A fix has been implemented and we are monitoring the system.
MONITORING
about 1 month ago - at 05/07/2026 12:09PM
A fix has been implemented and we are monitoring the results.
IDENTIFIED
about 1 month ago - at 05/07/2026 12:06PM
Executions are running fine now. However, there is still some slowness in the execution graph generation so we might see some delay in the execution updates to show up in UI.
But executions would work without any delay/slowness.
IDENTIFIED
about 1 month ago - at 05/07/2026 11:20AM
We have identified the root cause as elevated queue depth and throughput saturation on the MongoDB layer, leading to processing latency. A fix is being implemented to optimize handling and restore database stability
INVESTIGATING
about 1 month ago - at 05/07/2026 10:19AM
We are continuing to investigate this issue.
INVESTIGATING
about 1 month ago - at 05/07/2026 09:08AM
We are currently investigating this issue.
Latest Harness outages
Intermittent 503s on IDP services - 3 days ago
FME SDKs - SDKs falling back to polling - 4 days ago
Testing Dev Status Page 3rd June - 6 days ago
Hosted CI Builds Failing Intermittently - 7 days ago
Testing Dev Status Page - 11 days ago
The Status Page Aggregator with Early Outage Detection
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with
