There are some things that have gotten a lot better. Only a year ago most of the stuff these models generated was buggy, crap and badly formatted. I was recently trying to switch this media player frontend to use OpenGL rendering so it would work in Wayland. There's literally zero documentation of using python-mpv + Qt6 widgets. (There's one example using QQuick, but I'm not about to convert my entire application from QWidgets to QQuick/qml). Specifically the initialization, paintGL and process handlers it wrote here seemed like they were actually novel:
..and mostly worked. (the other stuff I've written). Things that are grunt work, like a basic confirmation dialog, it can save a lot of time on. Claude Code wrote the basics of this, matched the style of the rest of my code, and mostly worked, although I still cleaned it up:
but they are literally weighted random word generators. I like the horoscope joke, because I know way too many people who swear by LLMs, even outside of coding. One developer I know seemed unbothered by lawyers using them when they generate non-existence cases. And when I really pressed him, he didn't understand the basics of transformers, embedding spaces, attention blocks .. a developer advocating for LLMs, even to the point of saying we're close to the movie Her, without understanding the fundamentals of how the machines work!
The dangers are not in the random word generators, but those who trust them as their new oracles. The morons who ask "GPT/Grock is this true?" without doing the most basic lookups.
@timkrief I'm not a defender of generative AI usually. But pretending it is fully random and totally useless is missing the point and guarantees us to not see the why of its success and why people use it.
It's not hallucinating or lying. I really hate it when articles keep using those terms. It can't do those things because it has no intent. There's no mens rea. In that sense, people need to understand it's a machine that randomly generates words, weighted to make them seem like coherent language.
LLMs are just good at getting things that look right by accident.