Conversation

Notices

1. Embed this notice
   lainy (lain@lain.com)'s status on Tuesday, 07-Jan-2025 15:07:06 JST lainy
   > nvidia giving us a cheap-ish 128gb workstation
   
   FINALLY
   • kaia likes this.
   • Embed this notice
     lainy (lain@lain.com)'s status on Tuesday, 07-Jan-2025 15:15:05 JST lainy

     in reply to

     • Ever Beedle
     @dave that's more than enough to run huge LLMs or generative models at home, they were mostly bottlenecked by the available VRAM
     kaia likes this.
   • Embed this notice
     Ever Beedle (dave@gleasonator.com)'s status on Tuesday, 07-Jan-2025 15:15:06 JST Ever Beedle

     in reply to

     @lain I'm skeptical that this thing is going to feel like a real workstation. 20 ARM cores doesn't bode well for single-threaded perf and creates compatibility issues, and if it's 1PFLOP in FP4 that means it's maybe a 5070 level GPU at most?