{"generator":"GNU social 2.0.2-dev","title":"Conversation","totalItems":3,"items":[{"actor":{"id":"https:\/\/infosec.exchange\/users\/dymaxion","displayName":"Eleanor Saitta","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/92115-original-tmp20240110010103.webp","rel":"avatar","type":"image\/webp","width":400,"height":400},{"url":"https:\/\/gnusocial.jp\/avatar\/92115-96-20240111113309.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/92115-48-20240110063025.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/92115-24-20240111113309.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"92115"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/92115-96-20240111113309.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"Thinking about security, failure, change, art, and living. Recruiting barbarians; complicate your narratives. Fractional CISO to startups via Systems Structure Ltd. HEL\/NYC\/LON","url":"https:\/\/infosec.exchange\/@dymaxion","portablecontacts_net":{"preferredUsername":"dymaxion","displayName":"Eleanor Saitta","note":"Thinking about security, failure, change, art, and living. Recruiting barbarians; complicate your narratives. Fractional CISO to startups via Systems Structure Ltd. HEL\/NYC\/LON"}},"content":"

@suzannealdrich<\/a>
The infrastructure needed to keep these machines happy is nontrivial. Each single server hosting eight graphics cards is north of a half million new, so even at ten cents on the dollar they're the cost of a new car and they're mostly designed to be used in clusters of at least eight and generally more like 64. They only have boot drives in the machine, if that, so you need an external storage server. The network cables they use run $600 for 3m. The switches run into the six figures too. The new hardware is designed for rack scale water cooling, so you're going to need to build a car-sized heat exchanger unless you want to literally just run all the faucets in your house wide open all day. And a half rack is still going to draw at least ten times what the entire rest of your house does.
@cstross<\/a><\/p>","generator":{"id":"tag:gnusocial.jp,2026-10-18:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/infosec.exchange\/users\/dymaxion\/statuses\/115360586722585923","object":{"id":"https:\/\/infosec.exchange\/users\/dymaxion\/statuses\/115360586722585923","objectType":"note","content":"

@suzannealdrich<\/a>
The infrastructure needed to keep these machines happy is nontrivial. Each single server hosting eight graphics cards is north of a half million new, so even at ten cents on the dollar they're the cost of a new car and they're mostly designed to be used in clusters of at least eight and generally more like 64. They only have boot drives in the machine, if that, so you need an external storage server. The network cables they use run $600 for 3m. The switches run into the six figures too. The new hardware is designed for rack scale water cooling, so you're going to need to build a car-sized heat exchanger unless you want to literally just run all the faucets in your house wide open all day. And a half rack is still going to draw at least ten times what the entire rest of your house does.
@cstross<\/a><\/p>","url":"https:\/\/infosec.exchange\/@dymaxion\/115360586722585923","status_net":{"notice_id":null}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/wandering.shop\/users\/cstross"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/hachyderm.io\/users\/suzannealdrich"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2025-10-12:objectType=thread:nonce=df37543fe8c25742","notice_info":{"local_id":"11291527","source":"ActivityPub"}},"published":"2025-10-12T13:48:07+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/infosec.exchange\/@dymaxion\/115360586722585923"},{"actor":{"id":"https:\/\/mastodon.online\/users\/ATLeagle","displayName":"mark","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/33848-original-tmp20221120165039.webp","rel":"avatar","type":"image\/webp","width":400,"height":400},{"url":"https:\/\/gnusocial.jp\/avatar\/33848-96-20230715063505.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/33848-48-20230715063505.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/33848-24-20230715063505.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"33848"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/33848-96-20230715063505.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"enshitification consultant. I like art and pictures of cats and birds and flowers. I like working on old cars, and hate living in a car based society.","url":"https:\/\/mastodon.online\/@ATLeagle","portablecontacts_net":{"preferredUsername":"ATLeagle","displayName":"mark","note":"enshitification consultant. I like art and pictures of cats and birds and flowers. I like working on old cars, and hate living in a car based society."}},"content":"

@jannem<\/a> @dymaxion<\/a> @suzannealdrich<\/a> @cstross<\/a> I am currently working on the possibility of removing a lot of A100s which are only 3 to 3.5 years old that were created just after the start of gpt\/llm fever. The gb200 \/ 300 are just that much better, and there isn't enough floor space available quickly enough. Its a crazy race. <\/p>

So ya, these aren't really home user level things, but they're pretty damn powerful and still air cooled.<\/p>","generator":{"id":"tag:gnusocial.jp,2026-10-18:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/mastodon.online\/users\/ATLeagle\/statuses\/115361505806095394","object":{"id":"https:\/\/mastodon.online\/users\/ATLeagle\/statuses\/115361505806095394","objectType":"note","content":"

@jannem<\/a> @dymaxion<\/a> @suzannealdrich<\/a> @cstross<\/a> I am currently working on the possibility of removing a lot of A100s which are only 3 to 3.5 years old that were created just after the start of gpt\/llm fever. The gb200 \/ 300 are just that much better, and there isn't enough floor space available quickly enough. Its a crazy race. <\/p>

So ya, these aren't really home user level things, but they're pretty damn powerful and still air cooled.<\/p>","url":"https:\/\/mastodon.online\/@ATLeagle\/115361505806095394","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/fosstodon.org\/users\/jannem\/statuses\/115360869035997276","url":"https:\/\/gnusocial.jp\/notice\/11291528"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/wandering.shop\/users\/cstross"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/fosstodon.org\/users\/jannem"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/infosec.exchange\/users\/dymaxion"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/hachyderm.io\/users\/suzannealdrich"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2025-10-12:objectType=thread:nonce=df37543fe8c25742","notice_info":{"local_id":"11291531","source":"ActivityPub"}},"published":"2025-10-12T13:48:06+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/mastodon.online\/@ATLeagle\/115361505806095394"},{"actor":{"id":"https:\/\/fosstodon.org\/users\/jannem","displayName":"Janne Moren","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/37107-original-tmp20260917233739.webp","rel":"avatar","type":"image\/webp","width":400,"height":400},{"url":"https:\/\/gnusocial.jp\/avatar\/37107-96-20260921165225.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/37107-48-20260919202731.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/37107-24-20260922085838.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"37107"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/37107-96-20260921165225.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"HPC support engineer in Okinawa, Japan. Former neuroscientist, former programmer.Photography, recreational programming and playing the sanshin are things I do. Sweden, Osaka and Okinawa are places I particularly care about.","url":"https:\/\/fosstodon.org\/@jannem","portablecontacts_net":{"preferredUsername":"jannem","displayName":"Janne Moren","note":"HPC support engineer in Okinawa, Japan. Former neuroscientist, former programmer.Photography, recreational programming and playing the sanshin are things I do. Sweden, Osaka and Okinawa are places I particularly care about."}},"content":"

@dymaxion<\/a> @suzannealdrich<\/a> @cstross<\/a>
I was going to say the same thing: none of this hardware is usable (never mind useful) in a homelab. <\/p>

With that said, 3-5 years is, I think, not unrealistic. We have racks with 8-9 year old GPUs and they're still in constant use today. <\/p>

While it might not be used for training, they could still be used for other tasks, or find second life in academic HPC centers.<\/p>

With Moore's Law on its last legs, they will likely be useful for a long while.<\/p>","generator":{"id":"tag:gnusocial.jp,2026-10-18:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/fosstodon.org\/users\/jannem\/statuses\/115360869035997276","object":{"id":"https:\/\/fosstodon.org\/users\/jannem\/statuses\/115360869035997276","objectType":"note","content":"

@dymaxion<\/a> @suzannealdrich<\/a> @cstross<\/a>
I was going to say the same thing: none of this hardware is usable (never mind useful) in a homelab. <\/p>

With that said, 3-5 years is, I think, not unrealistic. We have racks with 8-9 year old GPUs and they're still in constant use today. <\/p>

While it might not be used for training, they could still be used for other tasks, or find second life in academic HPC centers.<\/p>

With Moore's Law on its last legs, they will likely be useful for a long while.<\/p>","url":"https:\/\/gnusocial.jp\/notice\/11291528","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/infosec.exchange\/users\/dymaxion\/statuses\/115360586722585923","url":"https:\/\/infosec.exchange\/@dymaxion\/115360586722585923"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/wandering.shop\/users\/cstross"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/infosec.exchange\/users\/dymaxion"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/hachyderm.io\/users\/suzannealdrich"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2025-10-12:objectType=thread:nonce=df37543fe8c25742","notice_info":{"local_id":"11291528","source":"ActivityPub"}},"published":"2025-10-12T13:48:06+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/gnusocial.jp\/notice\/11291528"}],"links":[{"url":"https:\/\/gnusocial.jp\/conversation\/5754947","rel":"alternate","type":"text\/html"}]}