Paul Cantrell
This from @caseynewton brings to the foreground something that’s been eating at me:
What exactly do Google and OpenAI and Microsoft and the rest of the AI bubble think is going to happen here when LLMs disincentivize the creation of the data that feeds them?!
https://www.platformer.news/google-io-ai-search-sundar-pichai/
Paul Cantrell
Working that out a bit:
The premise of the ad-supported web is that you profit by driving traffic to your site. The premise of LLMs is in large part to •supplant• traffic to web sites. LLMs need people to keep creating web sites. (More in the article.)
In private, behind closed doors, is the expectation that…well, what? That people will just keep posting useful bot-visible information for free?
Paul Cantrell
Is there an expectation that AI model trainers will end up paying for content, and ad revenue is supplanted by “LLM training data fee” revenue? (I can’t imagine GoogleAISoft’s investors think that’s the high-ROI lucrative future they’ve buying.)
Do they privately know this LLM stuff is a bubble, and expect it to burst before data source die-out kills it?
At a guess, it’s all just FOMO greed-panic and nobody’s thinking that far ahead. But truly, I wonder! What •do• they think will happen?!
Paul Cantrell
Yeah, I think @sysadmin1138 nailed it.
https://octodon.social/@sysadmin1138/112442908788514243
Paul Cantrell
@ravenonthill
Have cayons ever been paid fairly?
Raven Onthill
@inthehands I think they're hoping to make underpaid canyons generate the content. That would be very strange.
John Anderson
@inthehands @caseynewton "An evil man will burn his own nation to the ground to rule over the ashes." --Fake Sun Tzu
John Wilson
@inthehands @sysadmin1138 not only privately held data that already exists
Just like you get access to certain services in exchange for you watching ads, in the future companies may compel you to produce new data for the continued use of services
Who wants to be the first company offering free or reduced price phone service in exchange for them recording your calls for AI training purposes?
Paul Cantrell
@crazybutable @sysadmin1138 Oh god, you’re right
Paul Cantrell
@crazybutable @sysadmin1138 I mean, you’re still thinking small. Your phone doesn’t just record your calls; the virtual assistant doesn’t just record your interaction. The mic of every internet-connected device is always on, and records and submits •everything• for training.
John Wilson
@inthehands @sysadmin1138 or sports venues putting clauses in saying they can use any captured footage of you to train their AIs (you already generally agree to a waiver to appear in ads)
Raven Onthill
@inthehands DYAC, but it was funny.
Paul Cantrell
@ravenonthill
I figured, and figured I should embrace it!
Pär Björklund
@inthehands if we're to believe the hype I guess the idea is that magic AGI that no longer require training data is the goal before the collapse
bensonk
@inthehands I think that most of these execs are making decisions in terms of the next quarter's share price, and little else. "How do we train the models when people stop creating data," is a mess they'll leave for the future. And when they get there, you can expect them to continue to do the most dystopian thing they can think of.
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.