@evan RFC 9309 and linked documents propose definitions that generally would not include ActivityPub software unless there is an AP-enabled spidering package. As such, the proposed standard would indicate robots.txt being irrelevant to most known AP software. https://www.rfc-editor.org/info/rfc9309