Like putting up a robots.txt file, it pretty much requires that a level of trust be held betwixt the two participants.
And as with the modern LLM scrapers gleefully programmed to ignore those files in order to siphon off the world's knowledge and throw the results into a billionaire's pet parakeet, no such trust can exist here.