Conversation

Notices

1. Embed this notice
   Michał "rysiek" Woźniak · 🇺🇦 (rysiek@mstdn.social)'s status on Wednesday, 19-Nov-2025 20:46:25 JST Michał "rysiek" Woźniak · 🇺🇦

   AWS, Microsoft Azure, and CloudFlare – services run by gigantic corporations with endless supply of money and talent – all experience catastrophic, global failures that take innumerable other services down with them within 30 days. :blob0w0:

   Meanwhile Wikipedia just keeps chugging along, globally stable and reliable as always. :blobcatlove:

   And yes, Wikimedia Foundation runs a pretty complex infrastructure:
   https://wikitech.wikimedia.org/wiki/Wikimedia_infrastructure

   #SysAdmin #CloudFlare #AWS #Azure #Wikipedia

   • Embed this notice
     Alexandre Oliva (lxo@snac.lx.oliva.nom.br)'s status on Thursday, 20-Nov-2025 03:39:32 JST Alexandre Oliva

     in reply to

     • Emilion
     thanks for doing that
     
     on top of that, we should probably also be arguing for such monopolistic behemoths to be broken up into tens if not hundreds of smaller companies, not only for reasons you raised, but for competition's sake
     
     CC: @emilion@infosec.exchange
     
   • Embed this notice
     Michał "rysiek" Woźniak · 🇺🇦 (rysiek@mstdn.social)'s status on Thursday, 20-Nov-2025 03:39:34 JST Michał "rysiek" Woźniak · 🇺🇦

     in reply to

     • Emilion

     @emilion thanks, I've had quite some luck with convincing management not to host stuff in "the Cloud", for years. Incidents like these happen to be extremely effective in such conversations. 👍

     Turns out when one actually tries arguing against the cargo-culting in our industry, instead of just throwing their arms and giving up from the get go, stuff like that can happen. 👀

     I just wonder what could be achieved if all that energy spent justifying CloudFlare's failures went into that instead! 🤔

   • Embed this notice
     Emilion (emilion@infosec.exchange)'s status on Thursday, 20-Nov-2025 03:39:35 JST Emilion

     in reply to

     @rysiek Noble goal but this will not work for the same reason there are so few global cloud providers. You can try asking executive management and your developers to move to IBM Cloud for example. Good luck. 😑

   • Embed this notice
     Emilion (emilion@infosec.exchange)'s status on Thursday, 20-Nov-2025 03:39:36 JST Emilion

     in reply to

     @rysiek Are you surprised? They are global service providers not local ISPs. The complexity is unavoidable. Failure is an inherent trait of complex systems. You can reduce the risk but cannot eliminate it.

   • Embed this notice
     Michał "rysiek" Woźniak · 🇺🇦 (rysiek@mstdn.social)'s status on Thursday, 20-Nov-2025 03:39:36 JST Michał "rysiek" Woźniak · 🇺🇦

     in reply to

     • Emilion

     @emilion I am not surprised. I am saying this is simply unacceptable.

     They made the decision to put themselves in a central, critical position for innumerable services, and as you say it is entirely obvious it's impossible to keep being reliable on that level of complexity and scale.

     Instead of justifying these failures, we should recognize this and remove them from that central, critical position. Instead of 5 or so huge companies that can't manage their complexity, we need hundreds that can.

   • Embed this notice
     Emilion (emilion@infosec.exchange)'s status on Thursday, 20-Nov-2025 03:39:37 JST Emilion

     in reply to

     @rysiek Does this invalidate my argument on complexity?

   • Embed this notice
     Michał "rysiek" Woźniak · 🇺🇦 (rysiek@mstdn.social)'s status on Thursday, 20-Nov-2025 03:39:37 JST Michał "rysiek" Woźniak · 🇺🇦

     in reply to

     • Emilion

     @emilion if your argument is that CloudFlare, AWS, Azure had become too complex to be reliable, we can agree.

   • Embed this notice
     Michał "rysiek" Woźniak · 🇺🇦 (rysiek@mstdn.social)'s status on Thursday, 20-Nov-2025 03:39:38 JST Michał "rysiek" Woźniak · 🇺🇦

     in reply to

     • Emilion

     @emilion you do realize that Wikipedia runs on infrastructure – including networking infrastructure – and that infrastructure is run and maintained by Wikimedia Foundation, right?
     https://wikitech.wikimedia.org/wiki/Wikimedia_infrastructure

     And I assure you if Wikipedia went down that would a global story as well.

   • Embed this notice
     Emilion (emilion@infosec.exchange)'s status on Thursday, 20-Nov-2025 03:39:39 JST Emilion

     in reply to

     @rysiek A bit unfair to compare Wikipedia to AWS or Cloudflare. Huge difference in complexity and profile of services. Network services are the most unforgiving to any mistakes. Barely anyone would notice if Wikipedia had a brief downtime. Networks have to be up 100% of the time which is a huge effort.