Conversation

Notices

1. Embed this notice
   Sexy Moon (moon@shitposter.club)'s status on Tuesday, 06-Feb-2024 07:40:27 JST Sexy Moon
   Local LLM is not remotely as good as ChatGPT for generating Pokemon. It adds extra crap in the JSON and omits stuff I asked for, the names suck, it mixes in real pokemon stuff.
   • :blobancap: :blobcattrans: :blobancap: :blobcattrans: :blobancap: :blobcattrans: likes this.
   • Embed this notice
     Sexy Moon (moon@shitposter.club)'s status on Tuesday, 06-Feb-2024 07:43:15 JST Sexy Moon

     in reply to
     Guess I just batch requests to OpenAI and pre-generate a bunch.
   • Embed this notice
     Sexy Moon (moon@shitposter.club)'s status on Tuesday, 06-Feb-2024 07:56:49 JST Sexy Moon

     in reply to

     • Moffin'tosh

     @moffintosh Yes I am using Llama.cpp. It creates impressive output but just not remotely as good as ChatGPT.

     As an example, here is one I generated from ChatGPT. It's perfect:

     { "name": "Galehawk", "inspiration_animal": "Hawk", "description": "Galehawk is a majestic avian Pokémon known for its aerial prowess and keen eyesight, ruling the skies with swift and precise attacks.", "attacks": [ { "name": "Tornado Dive", "description": "Galehawk soars into the sky and dives like a tornado at its opponent, dealing flying-type damage." }, { "name": "Aerial Slash", "description": "Galehawk performs a swift and powerful aerial slash, dealing flying-type damage to all opponents." }, { "name": "Hurricane Fury", "description": "Galehawk conjures a fierce hurricane that engulfs all opponents in a storm, dealing flying-type damage." } ] }
   • Embed this notice
     Moffin'tosh (moffintosh@mastodon.cloud)'s status on Tuesday, 06-Feb-2024 07:56:51 JST Moffin'tosh

     in reply to

     @Moon The llama thinghie?

   • Embed this notice
     Sexy Moon (moon@shitposter.club)'s status on Tuesday, 06-Feb-2024 07:57:40 JST Sexy Moon

     in reply to

     • Moffin'tosh
     @moffintosh The Llama.cpp output, if I got it years ago, would be an incredible, incredible accomplishment. But if I want to save work, then I use ChatGPT here.
   • Embed this notice
     iced depresso (icedquinn@blob.cat)'s status on Tuesday, 06-Feb-2024 07:58:51 JST iced depresso

     in reply to

     • Moffin'tosh
     @Moon @moffintosh llama just runs a model, so this series of statements is somewhat meaningless without mentioning the model in question.
   • Embed this notice
     Sexy Moon (moon@shitposter.club)'s status on Tuesday, 06-Feb-2024 07:59:24 JST Sexy Moon

     in reply to

     • iced depresso
     • Moffin'tosh
     @icedquinn @moffintosh consider that I don't know what I'm doing yet.
   • Embed this notice
     iced depresso (icedquinn@blob.cat)'s status on Tuesday, 06-Feb-2024 07:59:59 JST iced depresso

     in reply to

     • Moffin'tosh
     @Moon @moffintosh you had to give it a gguf file at some point
   • Embed this notice
     Sexy Moon (moon@shitposter.club)'s status on Tuesday, 06-Feb-2024 08:06:42 JST Sexy Moon

     in reply to

     • iced depresso
     • Moffin'tosh
     @icedquinn @moffintosh yi-34b-200k-dare-megamerge-v8.Q4_K_M.gguf
     
     I just swapped to mythomax-l2-kimiko-v2-13b.Q6_K.gguf and it's way better.