Conversation

Notices

1. Embed this notice
   fuggy@skippers-bin.com's status on Tuesday, 27-Feb-2024 17:40:40 JST fuggy

   Merging some AI mode.. Oh what's this? Out of mem--- Anyway as I was saying merging some AI models in hopes to create a LLM that's better at Japanese

   •  likes this.
   • Embed this notice
      (mint@ryona.agency)'s status on Tuesday, 27-Feb-2024 17:41:37 JST 

     in reply to
     @fuggy >70b in swap
     The memes speak for themselves.
     1692881494999.png
   • Embed this notice
     fuggy@skippers-bin.com's status on Tuesday, 27-Feb-2024 18:25:20 JST fuggy

     in reply to

     • 

     @mint@ryona.agency it turns out I didn't need it actually, the model I was using caused a memory leak which led me to believe I needed more memory. It was the Miqu leak which was only released in like 4 bits or something, so it was a dequantization up to fp16 but broken, found another that worked and never went above like 30GBs of RAM. But in the end it was a fruitless endeavor because the model is retarded, not only is the Japanese bad it's utterly useless in English and Japanese making complete nonsense schizo rants. It does really like the letter Q though, maybe I accidentally created that Q* thing that was fake and gay

      likes this.
   • Embed this notice
     fuggy@skippers-bin.com's status on Tuesday, 27-Feb-2024 18:26:01 JST fuggy

     in reply to

     • 

     @mint@ryona.agency it does seem to have a pattern maybe, even if was a complete fail I find it rather interesting. Not sure what caused it

      likes this.
   • Embed this notice
      (mint@ryona.agency)'s status on Tuesday, 27-Feb-2024 18:28:37 JST 

     in reply to
     @fuggy Trust the plan. #Q #WWG1WGA #rape