Conversation
Notices
-
Embed this notice
the cure for ai slop is a 1986 aircraft manual
- T man :sex: :puffgiga: :puffpowerroll: likes this.
-
Embed this notice
@sun @lain former is grammar, latter is structured output
it is the mechanism that I meant, yes. Problem with grammar is that it is dog slow when doing stuff like that, apparently. Plus token!=word so tough to implement.
Also, like I said, model does not "see" that you're doing this, internally.
-
Embed this notice
@lain It's actually an interesting video. I wonder how tough it would be to abuse structured output or constrained grammars to this end, i.e. raising the logits of the period continuously. Probably pretty hard though because the way the APIs are going they are hiding all the inner workings, plus that doesn't really propagate back into the NN to tell it to "wrap it up"
-
Embed this notice
@WandererUber @lain llama.cpp lets you enforce a regular grammar on output and I think also now you can do it sort of with some others using json-schema, is that the same thing?
-
Embed this notice
@lain you laugh but honestly I think if there’s any text to go in a YouTube thumbnail it’d rather it be the video title rather than “ITS OVER” or “DISASTER” or whatever clickbait garbage gets you on the algorithm these days.
-
Embed this notice
@pettanko @lain the CCP is DONE
-
Embed this notice
@mischievoustomato @pettanko i had to write a youtube userscript that blocks everything with dubai in its name because it would show me 9001 "DUBAI IS OVER" videos with burning burj khalifa (i live next to the burj khalifa and would have noticed)
-
Embed this notice
@hakui @mischievoustomato @pettanko it was ramadan after all
-
Embed this notice
@lain @mischievoustomato @pettanko it was burning very discreetly so as to not bother the neighbors
-
Embed this notice
@romin @mischievoustomato @pettanko it's still not on fire
-
Embed this notice
@lain @mischievoustomato @pettanko check again
-
Embed this notice
@lain @mischievoustomato @pettanko are you sure
-
Embed this notice
@romin @lain @mischievoustomato @pettanko
mika_stove.png
-
Embed this notice
@lain Actually fascinating video, even if you dont vibewrite(tm). I really like how he basically highlights the importance of an editing pass and understanding *what* your writing is accomplishing and the target audience is. I find a lot nowdays that writing is taught to write how your teacher/prof wants the piece written, rather than writing in systematic ways that is aware of the goals of the piece and the audience that will read the piece.
I find a lot in writing nowdays that people cobble together a string of words where how much extra big words or superfluous meaning is often the judge of "how good your writing is." Which is quite funny because AI slop as per the video's definition is often how writing classes are taught (in my experience). Often things like word count (slop habit 5), use of vocabulary and adding more variety to word choice (slop habits 4 & 6), and not having excessive "repetition" (habit 1), are usually characteristics in which writing is judged. This is usually driven to the logical extent of dancing around the idea with 150 words rather than describing the whole thing in 15.
Also highlight how much the editing phase SUCKS like youre telling me i have to read my OWN writing AGAIN???
-
Embed this notice
@theorytoe i wonder what's better, letting the LLM do the writing and the human do the editing or vice reversa
-
Embed this notice
@lain
To be honest, I find myself more using the LLM to get to some starting point and then having myself take over to do the rest. I find it extremely useful for getting the ball rolling or taking something I don't like and seeing how it tweaks the writing. When there is a specific vision for what I want to write I'll just do it myself, since its easier to just put it down on paper then read it over.
-
Embed this notice
@lain now if its throwaway writing for a thing I dont care about then I really dont care about what happens, as long as the read over makes sense and fits the requirements thats enough for me 2 ship it
-
Embed this notice
@theorytoe i've had very good success with spinning out ideas with a long running agent that knows more about me than a one-off, then building up code or stories that way.