Outage in Blacksmith
Upstream Ubuntu package mirror outage affecting apt
Resolved Minor
September 11, 2026 - Started 12 days ago
- Lasted about 1 hour
Incident Report
Summary AI Generated
Canonical experienced multiple outages affecting their Ubuntu package mirrors (archive.ubuntu.com, us.archive.ubuntu.com, and security.ubuntu.com) starting at 06:30 UTC, causing apt-get steps in Blacksmith jobs to fail or hang intermittently. The issue persisted even after Canonical marked it resolved, impacting CI/CD pipelines relying on these mirrors. Blacksmith deployed a mitigation routing apt traffic through azure.archive.ubuntu.com to bypass the affected mirrors and unblock impacted jobs.
Since 06:30 UTC Canonical has had three outages affecting [archive.ubuntu.com](http://archive.ubuntu.com), [us.archive.ubuntu.com](http://us.archive.ubuntu.com) and [security.ubuntu.com](http://security.ubuntu.com). Although they have marked these as resolved, we are still seeing intermittent connection failures to those mirrors, which can cause apt-get steps to fail or hang. In the meantime, pointing apt at [azure.archive.ubuntu.com](http://azure.archive.ubuntu.com) instead of [archive.ubuntu.com](http://archive.ubuntu.com) and [security.ubuntu.com](http://security.ubuntu.com) will unblock affected jobs.
Trusted by 1,000+ teams
The Status Page Aggregator with Early Outage Detection
Stop finding out about outages from your users. Monitor 6,320+ cloud services and get alerted the second something breaks.
Latest Updates ( sorted recent to last )
MONITORING
13 days ago - at 09/11/2026 05:30AM
Since 06:30 UTC Canonical has had three outages affecting [archive.ubuntu.com](http://archive.ubuntu.com), [us.archive.ubuntu.com](http://us.archive.ubuntu.com) and [security.ubuntu.com](http://security.ubuntu.com). Although they have marked these as resolved, we are still seeing intermittent connection failures to those mirrors, which can cause apt-get steps to fail or hang. In the meantime, pointing apt at [azure.archive.ubuntu.com](http://azure.archive.ubuntu.com) instead of [archive.ubuntu.com](http://archive.ubuntu.com) and [security.ubuntu.com](http://security.ubuntu.com) will unblock affected jobs.
MONITORING
12 days ago - at 09/11/2026 02:21PM
We are deploying a mitigation on our side that routes apt around the affected Canonical mirrors. For the time being pointing apt at [azure.archive.ubuntu.com](http://azure.archive.ubuntu.com) in place of [archive.ubuntu.com](http://archive.ubuntu.com) and [security.ubuntu.com](http://security.ubuntu.com) will unblock affected jobs.
Latest Blacksmith outages
Elevated error rates in Blacksmith APIs - 2 days ago
Degraded US East AWS connectivity - 11 days ago
Job failures in EU West - 15 days ago
US West storage cluster degradation - 21 days ago
The Status Page Aggregator with Early Outage Detection
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 6320 services available
Integrations with
