Huh, this is a bit as if you would accuse a hammer to not be able to drive in a nail by itself.
LLMs are tools, not miracles. If you want them to generate more than a single LOC in a useful way, you need to embed this in larger process, in a program of its own, which uses the LLM to reason about a solution to the problem, in many small steps.
Projects like https://github.com/gpt-engineer-org/gpt-engineer are steps into this direction.