@LorenzoAncora @lxo @tennoseremel You are doom to failure if you try to detect scrapers via software that runs on the scraper.

Some scrapers now just programmatically command standard web browsers, which means you cannot distinguish them from humans that use the same browsers.

More pointless JavaScript executed → more pollution.


If you want to detect scrapers, the only effective techniques is server side heuristics, honeypots and tarpits.