Conversation

Notices

1. Embed this notice
   kaia (kaia@brotka.st)'s status on Monday, 27-Jan-2025 22:07:18 JST kaia

   • :sprout: evil mental tofu haver
   @FloatingGhost how are you installing it? :jelpeek:
   • Embed this notice
     lainy (lain@lain.com)'s status on Monday, 27-Jan-2025 22:19:03 JST lainy

     in reply to

     • :sprout: evil mental tofu haver
     @kaia @FloatingGhost ollama is still the easiest way, but the variants that can be run at home are not the “real” R1 but distilled versions based on qwen or llama
     kaia likes this.
   • Embed this notice
     lainy (lain@lain.com)'s status on Monday, 27-Jan-2025 22:25:29 JST lainy

     in reply to

     • :sprout: evil mental tofu haver
     • feliks
     @feliks @kaia @FloatingGhost yeah if you have a few hundreds gigs of vram you can do it
     kaia likes this.
   • Embed this notice
     feliks (feliks@chaos.social)'s status on Monday, 27-Jan-2025 22:25:31 JST feliks

     in reply to

     • :sprout: evil mental tofu haver
     • lainy

     @lain @kaia @FloatingGhost you can still run the original if you have the hardware though

     kaia likes this.
   • Embed this notice
     kaia (kaia@brotka.st)'s status on Monday, 27-Jan-2025 22:34:41 JST kaia

     in reply to

     • :sprout: evil mental tofu haver
     • lainy
     @lain @FloatingGhost this is quite cool! it can also respond in fluent German. I'll use it for prepping speech for tonight.
     lainy likes this.
   • Embed this notice
     feliks (feliks@chaos.social)'s status on Monday, 27-Jan-2025 22:54:44 JST feliks

     in reply to

     • :sprout: evil mental tofu haver
     • lainy

     @lain @kaia @FloatingGhost it's just 1.4TB VRAM... or 16x A100 80GB... well...

     https://apxml.com/posts/gpu-requirements-deepseek-r1

     kaia likes this.
   • Embed this notice
     lainy (lain@lain.com)'s status on Monday, 27-Jan-2025 23:03:57 JST lainy

     in reply to

     • :sprout: evil mental tofu haver
     • feliks
     @feliks @kaia @FloatingGhost going to aldi to buy some cards to run this
     kaia likes this.