the essential limitation with llm-generated code doesn't have anything to do with the capabilities of the model imo. the limitation is epistemological: how do I know if the code is correct? in order to know that for sure, you have to understand what the code is doing. in order to understand what the code is doing, you need to exert at least as much effort as you would have writing the code yourself in the first place. so the llm generation is always strictly a waste