@wraptile Scraping data to proprietarize it is not legitimate.
As for the legality part, I wouldn't regard it as "perfectly legal" - sure you making something publicly available authorizes others to download it, but it doesn't authorize them to do many things like infringe your copyright.
@wraptile But not all of the bots are there to crawl for legitimate use such as search engines. Many are scraping data to train AI models and other stuff.
@nixCraft why do people keep sharing this. Web traffic being automated does NOT mean dead internet bots.
It's just web scrapers and normal automation - do we imply that web shouldn't be automated? Am I supposed to do manual labor at all times and write down page results with pen and paper or smt?