Outage in CocoaPods

CDN Unreliable

Resolved Major
May 11, 2022 - Started almost 2 years ago - Lasted about 4 hours
Official incident page

Need to monitor CocoaPods outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including CocoaPods, and never miss an outage again.
Start Free Trial

Outage Details

Our DNS provider and front-end to the CDN Cloudflare has triggered a DDoS detection with normal CocoaPods traffic to the CDN. We have a raised support request with them and are figuring out how to bypass. https://github.com/CocoaPods/CocoaPods/issues/11355
Components affected
CocoaPods CDN
Latest Updates ( sorted recent to last )
MONITORING almost 2 years ago - at 05/11/2022 03:18PM

We think this is fixed, and is now in monitoring.

The DDoS detection was triggered which can happen occasionally because CDN activity is still going up overall. It looks like traffic bounces over a threshold for stricter rules now. The way DDoS detection works in Cloudflare is through a series of rules/heuristics which can be individually tuned ( which is what I looked at in https://github.com/CocoaPods/CocoaPods/issues/11355#issuecomment-1123465704 .)

After tuning the one people were hitting down, we paused a bit to determine if it was making changes. After seeing no changes, we flipped every rule/heuristic to off https://github.com/CocoaPods/CocoaPods/issues/11355#issuecomment-1123499704

What we were seeing was still similar CDN traffic patterns but some traffic occasionally getting through correctly. This was when we reached out to Cloudflare support. With their help we determined that it was likely that the migration of our rules from the central settings repo to the different CDN edges (e.g. for simplicity think the servers closest to users each time) were using the cached (older) settings.

This meant some regions didn't have the new rules saying ignore the rule about 'allow the custom user-agent' - the Cloudflare support folks clears up the cache and now its looking like everything is working fine.

I'm going to maybe give till the weekend till I go and turn back on some of the DDoS settings (but not the main culprit) - giving me now time to go do some [baking with my wife](https://mastodon.social/@orta/108243829603470408) on our day off :P

IDENTIFIED almost 2 years ago - at 05/11/2022 02:35PM

We've been in conversation with Cloudflare, still figuring it out, no hard ETA yet but things are happening

IDENTIFIED almost 2 years ago - at 05/11/2022 11:19AM

Our DNS provider and front-end to the CDN Cloudflare has triggered a DDoS detection with normal CocoaPods traffic to the CDN. We have a raised support request with them and are figuring out how to bypass.

https://github.com/CocoaPods/CocoaPods/issues/11355

Latest CocoaPods outages

CDN down due to DNS issues - over 3 years ago
Maintenance work on Trunk - about 5 years ago
CocoaPods Search is Unresponsive - about 6 years ago
Trunk pushing to GitHub is down - over 7 years ago

Streamline vendor monitoring with our Status Page Aggregator

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3167 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime