Conversation

Notices

1. Embed this notice
   Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:18 JST Angle🖇

   Aaaagh, AI is so weird! Like, minor differences in words can make a huge, huge, huge difference in performance! And I thought I was picky about word usage and prone to 'Well, acktually'ing people over it, but apparently not enough! It's bizarre. I'm starting to get a feel for it, though. :/

   • Embed this notice
     purple 👊✊💨 (purple@nya.social)'s status on Wednesday, 09-Jul-2025 09:23:01 JST purple 👊✊💨

     in reply to

     @Angle@anticapitalist.party hahahahahahahaha
     
     if only it were that easy. you won't get much of anywhere by connecting LLMs to each other.

     Doughnut Lollipop 【記録係】:blobfoxgooglymlem: likes this.
   • Embed this notice
     Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:02 JST Angle🖇

     in reply to

     • purple 👊✊💨

     @purple Just use LM Studio? Should be a matter of minutes to get it set up and running, if you're got the hardware. Well, I guess you'll need to download the models, but that can be done quite comfortably in the background. :/

   • Embed this notice
     purple 👊✊💨 (purple@nya.social)'s status on Wednesday, 09-Jul-2025 09:23:04 JST purple 👊✊💨

     in reply to

     @Angle@anticapitalist.party correct, they (supposedly) make tools to be used by other tools, which is how we're doing it. the company i contract with is the "elsewhere" you mention, although that is currently only because it's the cheapest way to get a specific vector product our tools need (embeddings -- base level stuff that is hard to run at-scale in somebody else's cloud cheaply). i'd be better off using claude ($) or a local MoE model like you mention.
     
     as for devstral, despite my best efforts i can't find the time to get stuff going on GPUs here at the house. i'm a fan of Mixtral, but i can only run stuff on CPUs at home so i don't use it for work where it's genuinely faster for me to code the dang script myself than it is to wait on some 8 year old AMDs i got kicking around.

   • Embed this notice
     Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:05 JST Angle🖇

     in reply to

     • purple 👊✊💨

     @purple Also note, from what I've heard OpenAI actually takes care to make sure that nothing they offer is particularly powerful - they don't turn a profit off of the models they make available and don't ever plan to, they just offer them so they can gather data on how they perform and use that to build bigger and better models. So, if you want to actually get your hands on something powerful and suited for your use case, you need to look elsewhere. :/

   • Embed this notice
     Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:06 JST Angle🖇

     in reply to

     • purple 👊✊💨

     @purple
     I've never used any of the GPTs much, so I can't compare it, but if you have the hardware (~20GB VRAM) I'd definitely say give Devstral a shot and see how it works for you. :/

   • Embed this notice
     Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:08 JST Angle🖇

     in reply to

     • purple 👊✊💨

     @purple I'm using Unsloths version of Devstral Q8_0, via LM Studio and Cline, and it's... Okay? Like, imagine someone who's genuinely a fair bit dumber than average, and not much good at anything besides coding... But has spent, like, 1000 years coding, and has gone through and used an inconceivably vast quantity of different tools and libraries. So, useful mainly for the stuff it knows, and less for its ability to apply it, but still quite useful.

   • Embed this notice
     purple 👊✊💨 (purple@nya.social)'s status on Wednesday, 09-Jul-2025 09:23:09 JST purple 👊✊💨

     in reply to

     @Angle@anticapitalist.party i'm an admin with > 20 years experience. the stuff AI puts out, and i'm talking o4-mini-high, their best tool for the job, is more like me as a teenager going through books that were already out of date and seeing what worked. it's extremely fever-dreamy. i use it a few times a week to do dull shit like "make a minimal bash script iterate over all aws efs shares and apply these security groups to each mount" which is one of those tasks with aws that is both recursive AND painful.
     
     but the ai doesn't know that you can't add security groups. you can only "update" them.
     
     my job is safe, for now.

     Doughnut Lollipop 【記録係】:blobfoxgooglymlem: likes this.
   • Embed this notice
     Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:10 JST Angle🖇

     in reply to

     Another note, running my local AI has caused me to indirectly learn a LOT about terminal commands, the linux filesystem, process management, test management, and all sorts of stuff. Like being able to sit and watch over the shoulder of another programmer who's not as smart as me, but *way*, *way* more experienced. And I've only been at it for a couple few weeks... :/

     Doughnut Lollipop 【記録係】:blobfoxgooglymlem: repeated this.
   • Embed this notice
     Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:11 JST Angle🖇

     in reply to

     Oh, and that's to say nothing of further developments in the field. If this is what I can do now, imagine what other people with more resources can do, or what will be possible later...?

   • Embed this notice
     Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:13 JST Angle🖇

     in reply to

     I guess there are some positives - if there was a technical problem you had that you struggled to solve because of a lack of expertise, good news! That problem will probably go away. On the other hand, uh, this will also remove a lot of barriers between people and the dangerous toys you don't want them to have, potentially? I dunno. And again, if you were hoping things would get less interesting, like, at any point, too bad lol. XD

   • Embed this notice
     Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:14 JST Angle🖇

     in reply to

     On the other hand, one upside! I don't ever expect to be truly bored, in my entire life, ever again. XD

   • Embed this notice
     Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:15 JST Angle🖇

     in reply to

     Though I suppose that's missing the forest for the trees - the existing job market is the least of our worries. This going to completely reshape the economy. Like, technical expertise is going to get a thousand times cheaper overall... I have no idea what that does. Opens a lot of doors and wildly destabilizes existing structures, I guess? I dunno. It's terrifying. :X

   • Embed this notice
     Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:16 JST Angle🖇

     in reply to

     So, uh, what now? This is, like, apocalyptic, in terms of my job prospects, isn't it? I've spent 15+ years learning to code, and now a $2600 computer + anybody with a handful of technical brain cells can outperform me? I mean, sure, I can use the thing too, probably better than a lot of them, but still... :/

   • Embed this notice
     Angle🖇 (angle@anticapitalist.party)'s status on Wednesday, 09-Jul-2025 09:23:17 JST Angle🖇

     in reply to

     Okay, tried a different system, found something much more reliable. Now have a fairly simple combination of technologies that's effectively a programmer slightly dumber than me but with vastly more experience - which overall, makes it a better programmer. And all this on my $2600 gaming PC. :/