Conversation

Notices

1. Embed this notice
   Kee Hinckley (nazgul@infosec.exchange)'s status on Friday, 19-Dec-2025 15:57:03 JST Kee Hinckley

   in reply to

   • Jürgen Hubert

   @juergen_hubert My wife subcontracts for somebody. And they recently gave her a proposal for a job that they would be working on, that had been written by an LLM. They said, "Don't write a proposal, just edit this."

   It was hell.

   She had to double check everything it said. Every page she had to add comments to. And then there were things that it had proposed that she didn't think made sense. But she had no way of knowing whether it was something that the person she was subcontracting too had wanted, or something the LLM had made up.

   And it had the usual problem, that the kinds of errors it made, were not the errors humans would make, and were much harder to catch.

   On top of all of that when it was finally done and went to the client, they got really upset because the proposal said that their existing system was "weak". You can see why an LLM would say that. If you're proposing enhancing a system, most likely the thing it's replacing was weak. But in this case that was not true, and the client was pretty pissed.

   Don't do it.

   • Embed this notice
     Jürgen Hubert (juergen_hubert@mementomori.social)'s status on Friday, 19-Dec-2025 15:57:05 JST Jürgen Hubert

     I fortunately haven't been in this position, but I imagine that proofreading #LLM -generated texts must be a miserable experience.

     With texts written by human authors, you can usually contact them and ask them: "What were your thought processes when using this sentence?" Since LLM do not "think", you cannot interrogate them on this, and thus it falls you to give meaning to their words.

     Furthermore, with human-written texts, both the original author and the proofreader share responsibility for the quality of the text - with the author having the bulk of the responsibility, while the proofreader is responsible for polishing it.

     But since LLM are intended as a tool for evading responsibility in its entirety, all the responsibility for the quality of the text lies with the proofreader! And who would want that for LLM-generated slop?

     GreenSkyOverMe (Monika) repeated this.