Conversation

Notices

1. Embed this notice
   silverwizard (silverwizard@convenient.email)'s status on Friday, 04-Apr-2025 22:15:34 JST silverwizard
   Been too long since I built a server. Supermicro apparently lost their way - do they have a successor?
   • Embed this notice
     da_667 (da_667@infosec.exchange)'s status on Friday, 04-Apr-2025 22:26:12 JST da_667

     in reply to

     @silverwizard if you're looking for minaturized hardware, the minisforum ms01 is REALLY good. Otherwise... I'm not sure about full-size server hardware

     silverwizard likes this.
   • Embed this notice
     silverwizard (silverwizard@convenient.email)'s status on Friday, 04-Apr-2025 22:26:37 JST silverwizard

     in reply to

     • da_667
     @da_667 This'll likely wanna go into a rack. But thanks! I've seen the miniforum and it looks cool as hell.
   • Embed this notice
     silverwizard (silverwizard@convenient.email)'s status on Friday, 04-Apr-2025 22:27:19 JST silverwizard

     in reply to

     • RootWyrm 🇺🇦:progress:
     @rootwyrm Ah right - this is a *for work* server. It needs to be full of GPUs and live in a rack and LARP that it's important
   • Embed this notice
     RootWyrm 🇺🇦:progress: (rootwyrm@weird.autos)'s status on Friday, 04-Apr-2025 22:27:21 JST RootWyrm 🇺🇦:progress:

     in reply to

     @silverwizard depends what _exactly_ you're looking for. Supermicro got themselves on my blacklist. Minisforum is okay if you want a desktop playing dressup, but I don't fully trust them long-term yet.

   • Embed this notice
     silverwizard (silverwizard@convenient.email)'s status on Friday, 04-Apr-2025 23:04:26 JST silverwizard

     in reply to

     • furicle
     • RootWyrm 🇺🇦:progress:
     @furicle @rootwyrm I would never pretend to be important
   • Embed this notice
     furicle (furicle@mastodon.social)'s status on Friday, 04-Apr-2025 23:04:27 JST furicle

     in reply to

     • RootWyrm 🇺🇦:progress:

     <joke incoming...>

     @silverwizard @rootwyrm

     > It needs to be full of GPUs and live in a
     > rack and LARP that it's important

     like those that admin it?

     </hides>

   • Embed this notice
     silverwizard (silverwizard@convenient.email)'s status on Friday, 04-Apr-2025 23:49:38 JST silverwizard

     in reply to

     • RootWyrm 🇺🇦:progress:

     @rootwyrm Who is paying: My CEO is asking for numbers, so probably no one - but I would like to collect realistic ones.

     Basically - we drank some AI koolaid and then realized it's not cost effective - so they want some numbers on things. So I'm just wondering what vendors people are using these days that aren't the big expensive ones.

     I know back in the day Supermicro was the go-to - and Dell is what a lot of people are using as IBM/Lenovo burns its entire brand down. But is there anything that's doing less mainstream work.

   • Embed this notice
     RootWyrm 🇺🇦:progress: (rootwyrm@weird.autos)'s status on Friday, 04-Apr-2025 23:49:39 JST RootWyrm 🇺🇦:progress:

     in reply to

     @silverwizard hoooooboy... uh, exactly how many and what flavor? Also, who's paying? Because, well, you are NOT gonna like the numbers.

   • Embed this notice
     furicle (furicle@mastodon.social)'s status on Friday, 04-Apr-2025 23:50:27 JST furicle

     in reply to

     • RootWyrm 🇺🇦:progress:

     @silverwizard @rootwyrm tell me what you end up doing - it would be nice to have some choice in that area

     silverwizard likes this.
   • Embed this notice
     silverwizard (silverwizard@convenient.email)'s status on Friday, 04-Apr-2025 23:51:20 JST silverwizard

     in reply to

     • furicle
     • RootWyrm 🇺🇦:progress:
     @furicle @rootwyrm To be clear - this project is at the point of "I don't think the CEO has realized we'll need to rent a shelf to store this", so I don't know where it's going to go.
   • Embed this notice
     silverwizard (silverwizard@convenient.email)'s status on Saturday, 05-Apr-2025 00:08:08 JST silverwizard

     in reply to

     • RootWyrm 🇺🇦:progress:
     @rootwyrm yeah - oh yeah - I'm not really expecting to not pay through the nose. But we're pretty deep in at this point.
   • Embed this notice
     RootWyrm 🇺🇦:progress: (rootwyrm@weird.autos)'s status on Saturday, 05-Apr-2025 00:08:10 JST RootWyrm 🇺🇦:progress:

     in reply to

     @silverwizard so, ballpark, it very much depends on the GPU class. That's your 90% cost, no joke.

     ASRock 8U8X-TURIN2 I can't give numbers on, as it's prelim. So, you'd be looking 4U8G-GNR2.

     Base chassis, ~$8-10k.
     CPU, >=$6k.
     RAM, >=$4k
     GPU, minimum is going to be NV L40S - MINIMUM.
     Those are $12k. Each. Minimum. To actually get them expect to pay $20k. Tariffs push that to $19k before 'fuck you' premiums. That's PER GPU and only 48GB which limits the models significantly.

   • Embed this notice
     silverwizard (silverwizard@convenient.email)'s status on Saturday, 05-Apr-2025 00:17:12 JST silverwizard

     in reply to

     • RootWyrm 🇺🇦:progress:
     @rootwyrm yep! It'll be fun. It's gonna be a weird dumb dead end. But that's not my problem :D
   • Embed this notice
     RootWyrm 🇺🇦:progress: (rootwyrm@weird.autos)'s status on Saturday, 05-Apr-2025 00:17:13 JST RootWyrm 🇺🇦:progress:

     in reply to

     @silverwizard sure, if you toss cost considerations out, there's options.
     Except my point is, there isn't.

     I am VERY good at sourcing hardware, thanks to 30+ years as an ODM/OEM. And I could not get you an RTX6000 Blackwell for anything, and the soonest I could get you an H100 is "maybe."
     This is not factoring in tariffs.

     It's just the fact that you are fighting every idiot on Earth for some of the worst yields I have ever seen. And NV is restricting most of the supply to high-profit ODM.

   • Embed this notice
     RootWyrm 🇺🇦:progress: (rootwyrm@weird.autos)'s status on Saturday, 05-Apr-2025 01:10:58 JST RootWyrm 🇺🇦:progress:

     in reply to

     @silverwizard yeah. Honestly the only way you'll get numbers on a single server is Dell/Lenovo/HPE/etc. and it'll be a 9+ month wait unless you have a multi-million per-quarter relationship.

     MOQs on ASRockRack and Mitac/Tyan are... prohibitive to say the least. The delusional are simply buying up all the production, continuously. I can get singles but I only do full cab HPC stuff these days.

     silverwizard likes this.
   • Embed this notice
     RootWyrm 🇺🇦:progress: (rootwyrm@weird.autos)'s status on Saturday, 05-Apr-2025 01:30:23 JST RootWyrm 🇺🇦:progress:

     in reply to

     @silverwizard also bear in mind that as of two days ago, ALL supply from everyone evaporated. Customers are scrambling to get hard commits for every single piece of already onshore hardware for literally everything.
     And I do mean *everything*.

     silverwizard likes this.
   • Embed this notice
     silverwizard (silverwizard@convenient.email)'s status on Saturday, 05-Apr-2025 03:00:26 JST silverwizard

     in reply to

     • jbcarroll
     @jbcarroll I think we're trying to rack it, but yeeeeeeah
   • Embed this notice
     jbcarroll (jbcarroll@friendica.jb-net.us)'s status on Saturday, 05-Apr-2025 03:00:27 JST jbcarroll

     in reply to
     @silverwizard Kinda a screwball way about it, but a Mac studio cluster maybe? 512GB of unified memory means you can run pretty large models after you cluster a few. 😁
   • Embed this notice
     Ben Zanin (gnomon@mastodon.social)'s status on Saturday, 05-Apr-2025 05:18:26 JST Ben Zanin

     in reply to

     @silverwizard I've had good luck with the ASRock Rack stuff.

     silverwizard likes this.
   • Embed this notice
     silverwizard (silverwizard@convenient.email)'s status on Saturday, 05-Apr-2025 05:18:46 JST silverwizard

     in reply to

     • Ben Zanin
     @gnomon Thanks! That's what I needed