I'm leading a non-profit team building a pathogen-agnostic early-warning system. We're running the world's largest metagenomic biosurveillance network and we're looking for people who know how to build and scale processing systems and infra. No bio background needed! https://www.jefftk.com/p/securebio-detection-is-hiring-software-engineers
@tw@crschmidt@cshabsin link preview bots all ignore robots.txt, so mastodon is at least following precedent here.
Except that I think Mastodon's implementation is wrong: on a centralized network the preview is created at the 'request' of the person sharing, so robots.txt doesn't apply. But here it's created fully automatically, so it really should apply. The fix would be to capture the site at sharing time and send it along in the post, which is also more efficient (though prone to abuse?)