"Taking a scaffolding built out of LLMs to regulate other LLMs’ and calling it “reason” is a surefire way to create a weird, incomprehensible system. Building infrastructure on top of this Frankenstein’s monster of automated statistics should be a terrifying proposition for anyone, not because it will decide to kill us — but because it’s an invisible bureaucracy incapable of deciding anything but potentially given authority to exercise power as if it does. "
(Original title: A Critique of Pure LLM Reason)
https://cyberneticforests.substack.com/p/a-critique-of-pure-llm-reason