Conversation

Notices

1. Embed this notice
   翠星石 (suiseiseki@freesoftwareextremist.com)'s status on Friday, 21-Mar-2025 14:59:15 JST 翠星石

   in reply to

   • H. Faust
   • vic
   @vic @hfaust You won't get very far with just Linux, as you'll just get a computer that doesn't complete booting and shuts down.
   
   "DGX OS" is a GNU/Linux distro.
   • Embed this notice
     vic (vic@shitpost.cloud)'s status on Friday, 21-Mar-2025 14:59:16 JST vic

     • H. Faust

     $3000 and can run 200B models? Not bad compared to $30000 for an H100. If all you care about is running the latest, biggest LLMs locally then it's the cheapest option by far. Otherwise you're looking at a Mac Studio.

     If it runs on plain old Linux (with the gay Nvidia drivers of course) then that's even better than Digits, which uses DGX OS.

     If only there was a truly neutral, uncensored LLM released to the wild. The possibilities would be endless.