Conversation

Notices

1. Embed this notice
   meso (meso@the.asbestos.cafe)'s status on Thursday, 10-Aug-2023 02:06:32 JST meso
   funny how AI has hardcoded stuff to comment on things about Donald Trump with him being evil. ask it to write fanfiction about him and itll go like OOO NOOO I CANT DO THAT HE IS AN ELECTION DENIER
   • Embed this notice
     Sexy Moon (moon@shitposter.club)'s status on Thursday, 10-Aug-2023 02:06:31 JST Sexy Moon

     in reply to
     @meso they're trying to work out a way to ban self-hosted AI but they can't so far because anybody with a good GPU can do it. But they're thinking hard.
     Fediverse Contractor likes this.
   • Embed this notice
     ☻ (mrsaturday@shitposter.club)'s status on Thursday, 10-Aug-2023 02:09:03 JST ☻

     in reply to

     • Sexy Moon
     @Moon @meso The amount of backpedaling and attempting to put the genie back in the bottle is insane, but not surprising. Seeing Tim Berners-Lee say if he could do the internet over again he'd make it easier to censor tells me everything I need to know about where tech is today.
     Sexy Moon likes this.
   • Embed this notice
     Sexy Moon (moon@shitposter.club)'s status on Thursday, 10-Aug-2023 02:09:22 JST Sexy Moon

     in reply to

     • ☻
     @mrsaturday @meso I'd love to learn more about the tim berners lee thing
   • Embed this notice
     Sexy Moon (moon@shitposter.club)'s status on Thursday, 10-Aug-2023 02:12:16 JST Sexy Moon

     in reply to
     @meso there are youtube videos that walk through every step. I kind of muddled through it. I'm generating cute girls right now but I am soon gonna try to generate text like stories and stuff.
   • Embed this notice
     meso (meso@the.asbestos.cafe)'s status on Thursday, 10-Aug-2023 02:12:17 JST meso

     in reply to

     • Sexy Moon
     @Moon do you have any resources on spinning up local AI
   • Embed this notice
     JAJAX (jajax@clubcyberia.co)'s status on Thursday, 10-Aug-2023 02:12:31 JST JAJAX

     in reply to

     • Sexy Moon
     @Moon @meso I tried to get chatGTP to draw ascii art of a cat with an ampersand in its mouth representing a mouse-- It refused until I told it ampersands represented cinnamon rolls.
     Sexy Moon likes this.
   • Embed this notice
     JAJAX (jajax@clubcyberia.co)'s status on Thursday, 10-Aug-2023 02:13:43 JST JAJAX

     in reply to

     • Sexy Moon
     @Moon @meso Yeah I want a chatgpt clone generating millions of threatening letters for me to send to three-letter organizations per second
     Sexy Moon likes this.
   • Embed this notice
     Sexy Moon (moon@shitposter.club)'s status on Thursday, 10-Aug-2023 02:14:07 JST Sexy Moon

     in reply to

     • Jeff "never puts away anything, especially oven mitts" Cliff, Bringer of Nightmares 🦝🐙🇱🇧🧯
     • ☻
     @jeffcliff @mrsaturday @meso that's a little different.
     Fediverse Contractor likes this.
   • Embed this notice
     Jeff "never puts away anything, especially oven mitts" Cliff, Bringer of Nightmares 🦝🐙🇱🇧🧯 (jeffcliff@shitposter.club)'s status on Thursday, 10-Aug-2023 02:14:08 JST Jeff "never puts away anything, especially oven mitts" Cliff, Bringer of Nightmares 🦝🐙🇱🇧🧯

     in reply to

     • Sexy Moon
     • ☻
     sir timbl supported DRM in HTML in '14
   • Embed this notice
     Christmas Man (christmas_man@thebag.social)'s status on Thursday, 10-Aug-2023 02:15:12 JST Christmas Man

     in reply to

     • Sexy Moon
     Which LLM are you looking at using?
   • Embed this notice
     Sexy Moon (moon@shitposter.club)'s status on Thursday, 10-Aug-2023 02:15:12 JST Sexy Moon

     in reply to

     • Christmas Man
     @Christmas_Man @meso dunno yet I just stumble through using google.
   • Embed this notice
     Mitch Conner (olmitch@shitposter.club)'s status on Thursday, 10-Aug-2023 02:22:40 JST Mitch Conner

     in reply to

     • Sexy Moon
     @meso @Moon
     > do you have any resources on spinning up local AI
     https://github.com/josStorer/selfhostedAI
     Sexy Moon likes this.
   • Embed this notice
     PapaPol (papapole@bae.st)'s status on Thursday, 10-Aug-2023 02:22:42 JST PapaPol

     in reply to

     • Sexy Moon
     • Mitch Conner
     @olmitch @Moon @meso i recently discovered this useful channel
     https://www.youtube.com/@ai-tools-search
     Sexy Moon likes this.
   • Embed this notice
     guizzy (in exile) (guizzy@shitposter.club)'s status on Thursday, 10-Aug-2023 02:29:30 JST guizzy (in exile)

     in reply to

     • Sexy Moon
     • Christmas Man
     @Moon @Christmas_Man @meso This is the guy making 4bit quantized models for home use: https://huggingface.co/TheBloke
     GPTQ models are for GPU based inference, GGML are for CPU based inference (though you can get speed boost from moving some of the load on your GPU).
     
     I'd recommend installing Oobabooga's Text Generation Webui. It's the Automatic1111 of LLMs: https://github.com/oobabooga/text-generation-webui
     
     With 24Gb VRAM, you can run GPTQ 13b to 20b models with room to spare for extended (over 2048 token) context and keeping Stable Diffusion loaded at the same time. Or you are supposed to be just about able to run 30b models with 2048 context on a headless linux machine. Expect double digit tokens per second. Answers will pop up in seconds.
     
     With GGML models your RAM is going to be your limit, and speed is going to depend on CPU, GPU, RAM speed and how much you can offload to GPU/VRAM. But in general it's likely to be MUCH slower than GPTQ, but if you're running as big a model as you can fit in your machine, expect single digit tokens per second. Expect to wait sometimes over a minute for an answer. Sometimes it's worth it, sometimes not. I've heard people say that the returns from 30b to 70b are quite a bit diminished (ie: it's not really noticeably smarter, just different).
     Sexy Moon likes this.
   • Embed this notice
     ☻ (mrsaturday@shitposter.club)'s status on Thursday, 10-Aug-2023 02:30:16 JST ☻

     in reply to

     • Sexy Moon
     • JAJAX
     @JAJAX @Moon @meso https://irishtechnews.ie/world-wide-web-founder-sir-tim-berners-lee-wants-google-and-facebook-to-tackle-fake-news/
     https://www.wired.com/story/tim-berners-lee-world-wide-web-anniversary/
     I saw it a while ago where he said he would have made it harder for things he doesn't like if he could do WWW over, but I can't find the link. I don't bookmark stuff because that was one of malware's favorite things to skim back in the day. Reading this he's talking out of both sides of his mouth. "I want data privacy (Google and Facebook end up poor) but I want Google and Facebook to work harder to 'combat misinformation' (with their ad money I took away, but this isn't going to inhibit free speech, no sir) but I want the web free and open to all (even though any political speech to the right of Ben Shapiro is viewed as misinformation and abuse by Big Tech and governments, and from what I can see, also Tim Berners-Lee)". In retrospect he's implicitly pro-censorship in that he doesn't understand the real-life consequences of his ideals.
     Sexy Moon likes this.
   • Embed this notice
     JAJAX (jajax@clubcyberia.co)'s status on Thursday, 10-Aug-2023 02:30:17 JST JAJAX

     in reply to

     • Sexy Moon
     • ☻
     @mrsaturday @Moon @meso lol you have a link for that? I want to see what this idiot's mindset is
   • Embed this notice
     JAJAX (jajax@clubcyberia.co)'s status on Thursday, 10-Aug-2023 02:35:04 JST JAJAX

     in reply to

     • Sexy Moon
     • ☻
     @mrsaturday @Moon @meso well he didn't understand the real consequences of his ideals originally, that's why he's trying to walk it back now
     Fediverse Contractor likes this.
   • Embed this notice
     JAJAX (jajax@clubcyberia.co)'s status on Thursday, 10-Aug-2023 02:40:37 JST JAJAX

     in reply to

     • Sexy Moon
     • ☻
     @mrsaturday @Moon @meso The real problem with people like TBL is they're starting to realize that there's no real incentive for average people to dedicate their lives to the universal equity and brotherhood ideal, especially when it requires them to give up their own hard-won standard of living. So they've drawn back on all their ideas of freedom of speech etc, and they're gonna try to force people to behave how they think they ought to instead.
   • Embed this notice
     ☻ (mrsaturday@shitposter.club)'s status on Thursday, 10-Aug-2023 02:40:38 JST ☻

     in reply to

     • Sexy Moon
     • JAJAX
     @JAJAX @Moon @meso Few people do, it's hard to grok the idea of humanity as 8 billion flailing retards rather than one singular unit