I wonder how much of the current AI bubble is really a front to build power infrastructure and data centres, so that we no longer have operational devices anymore and must resort to using their cloud services.
Classic rent seeking behaviours.
I wonder how much of the current AI bubble is really a front to build power infrastructure and data centres, so that we no longer have operational devices anymore and must resort to using their cloud services.
Classic rent seeking behaviours.
@mayintoronto @dfloyd888 A bottom tier Android phone repurposed is an order of magnitude more computing power than what any reasonably sized company actually *needs* for its servers. Only horribly inefficient software is preventing us from having a future where the cheap client devices they want us to use to rent their cloud shit just replace the cloud shit.
@mayintoronto I feel it will backfire if there is that assumption. There is an entire movement for sovereign clouds and sovereign LLMs, coupled with people losing interest in cloud services.
The days of storing data on foreign government's soil, or a foreign government's company are becoming stuff in the rear view mirror.
@dfloyd888 not if there's no RAM or graphics cards available to build your publicly owned data centres.
Or hard drives. https://mashable.com/article/ai-hard-drive-hdd-shortages-western-digital-sold-out
Related thread: https://beige.party/@ZenHeathen/116077245972589149
But you need to keep in mind that this isn't just about consumer hardware. Everyone's going to get hit by this, from individuals to institutions to the biggest corporations. If you can't buy hardware, your operational risk requires you to rent it.
I'm surprised governments and megacorps aren't freaking out.
@mayintoronto For AI data centers built directly by AI companies, there's also the question if they even have suitable hardware and software infrastructure that would let them rent out general purpose capacity in AWS/Google Cloud like ways. The software, hardware, and operational stack for that is complex and hard to build and operate (just look at AWS outage reports for some of the hidden surprises, and AWS has been doing this for a long time).
@cks @mayintoronto It's very possible that the executive class *thinks* this will be infrastructure they can repurpose when the bubble pops because they have utterly zero understanding of it except what their yes-men tell them, and simultaneously that it's all actually useless.
@mayintoronto On the one hand this feels alarmingly possible. On the other hand, I'm reading stories about how planned data centers can't get turned on because there's no power (and when they put in power it's the most expensive, terrible power there is because that's what's available right now), and NVidia isn't even promising generation to generation compatibility for their DC racks, which almost certainly can't be reused for anything else. This doesn't feel like viable general infrastructure.
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.