Public
- Public
- Network
- Groups
- Featured
- Popular
- People

Conversation

Notices

Embed this notice
Karl Voit :emacs: :orgmode: (publicvoit@graz.social)'s status on Monday, 24-Jun-2024 04:33:35 JST Karl Voit :emacs: :orgmode:

Exclusive-Multiple #AI companies bypassing web standard to scrape publisher sites, licensing firm says
https://finance.yahoo.com/news/exclusive-multiple-ai-companies-bypassing-143742513.html?guccounter=1
"A Wired investigation published this week found Perplexity likely bypassing efforts to block its web crawler via the Robots Exclusion Protocol, or "robots.txt," a widely accepted standard meant to determine which parts of a site are allowed to be crawled."
In conversation Monday, 24-Jun-2024 04:33:35 JST from graz.social permalink
Attachments
1. Domain not in remote thumbnail source whitelist: media.zenfs.com
  
  Exclusive-Multiple AI companies bypassing web standard to scrape publisher sites, licensing firm says
  
  (Reuters) -Multiple artificial intelligence companies are circumventing a common web standard used by publishers to block the scraping of their content for use in generative AI systems, content licensing startup TollBit has told publishers. A letter to publishers seen by Reuters on Friday, which does not name the AI companies or the publishers affected, comes amid a public dispute between AI search startup Perplexity and media outlet Forbes involving the same web standard and a broader debate between tech and media firms over the value of content in the age of generative AI.

Feeds