Public
- Public
- Network
- Groups
- Featured
- Popular
- People

Conversation

Notices

Embed this notice
Neil Craig (tdp_org@mastodon.social)'s status on Friday, 24-Nov-2023 12:20:45 JST Neil Craig

Hands up if you caused a global outage today...
Just me?
Sorry!
I was making a change to our "outside the UK" CDN config today for www.bbc.co.uk & www.bbc.com & the change included 2 bugs which pre-testing didn't spot:
- A regex typo which caused 404s on www.bbc.co.uk
- An incorrect TLS cert on the CDN origin which caused 503s on www.bbc.com
These caused ~7 minutes of significant global outage.
I spent most of the afternoon writing tests to catch this for next time.
#DevOps #WebDev #CDN
In conversation about a year ago from mastodon.social permalink
Attachments
1. Domain not in remote thumbnail source whitelist: ichef.bbc.co.uk
  
  BBC - Homepage
  
  Breaking news, sport, TV, radio and a whole lot more. The BBC informs, educates and entertains - wherever you are, whatever your age.
2. Cache status graph for www.bbc.co.uk which shows a significant spike of "error" for ~7 minutes
  https://files.mastodon.social/media_attachments/files/111/462/144/813/232/376/original/1d1002995144a1ba.png
3. Cache status graph for www.bbc.com which shows a significant spike of "error" for ~7 minutes
  https://files.mastodon.social/media_attachments/files/111/462/144/896/717/749/original/d2b4188c58495a25.png
4. No result found on File_thumbnail lookup.
  
  BBC - Home
  
  from @BBC
  
  The best of the BBC, with the latest news and sport headlines, weather, TV & radio highlights and much more from across the whole of BBC Online.
- feld likes this.

Public

Conversation

Notices

Feeds