Conversation

Notices

1. Embed this notice
   :blobcathug: (jain@blob.cat)'s status on Sunday, 20-Jul-2025 19:13:13 JST :blobcathug:
   5x 2 cpus (12 cores / 24) and each cpu has 768GB RAM making 120c/240t + 7.5TB RAM
   
   RE: https://blob.cat/objects/29dcda3d-c051-43e4-a203-71a7a336aad9
   • Embed this notice
     :blobcathug: (jain@blob.cat)'s status on Sunday, 20-Jul-2025 19:14:06 JST :blobcathug:

     in reply to

     • Toasterson
     @Toasterson ^
   • Embed this notice
     :blobcathug: (jain@blob.cat)'s status on Sunday, 20-Jul-2025 19:15:48 JST :blobcathug:

     in reply to

     • Toasterson
     @Toasterson sicher, GPUs wäre zwar nätt aber passe nid i 2h ine
   • Embed this notice
     Toasterson (toasterson@chaos.social)'s status on Sunday, 20-Jul-2025 19:15:49 JST Toasterson

     in reply to

     @Jain Da lauft keis LLM drufe. Brusch GPU.

   • Embed this notice
     :blobcathug: (jain@blob.cat)'s status on Sunday, 20-Jul-2025 19:36:15 JST :blobcathug:

     in reply to

     • foxcat :debian::linuxmint:
     @foxcat ^
   • Embed this notice
     Cloud Floof of Fedi :samoyed: (floofer@mk.catgirlsfor.science)'s status on Sunday, 20-Jul-2025 19:42:06 JST Cloud Floof of Fedi :samoyed:

     in reply to

     @Jain@blob.cat that’s a tasty looking power bill you have there

     :blobcathug: likes this.
   • Embed this notice
     :blobcathug: (jain@blob.cat)'s status on Monday, 21-Jul-2025 04:00:53 JST :blobcathug:

     in reply to

     • Toasterson
     @Toasterson anderi Math bruchts nid aber logisch si gpus schneller für das...
     deepseek-r1-671.0B Q4_K_M louft öbbe mit 2 Tokens pro Sekunde uf 400GB RAM
   • Embed this notice
     Toasterson (toasterson@chaos.social)'s status on Monday, 21-Jul-2025 04:00:55 JST Toasterson

     in reply to

     @Jain Das sind huere geili VM Hosts aber LLM bruched anderi Math. Da bruscht GPU. Desktop GPU langed aber au scho.

   • Embed this notice
     :blobcathug: (jain@blob.cat)'s status on Monday, 21-Jul-2025 04:05:45 JST :blobcathug:

     in reply to

     • Toasterson
     @Toasterson Ja sicher, aber es isch ja ou nid d idee ds 32B Model la ds loufe... Ig wette das würd ou vil schneller loufe
   • Embed this notice
     Toasterson (toasterson@chaos.social)'s status on Monday, 21-Jul-2025 04:05:47 JST Toasterson

     in reply to

     @Jain Ja das isch eindütig nid schnell. E GPu chan s 32B modell recht guet bruche. Das wird vermuetli bi di au laufe.