Some days I'm an utter idiot. Spent quite some time today debugging why after a restart caddy was failing to get a new cert and was failing all the ACME challenges. Sooo it turns out small annie some time ago decided "I don't really like people even trying to connect to my webserver via http, how about I just block that from outside my network"