@chris @neil my experience of it for code falls into two camps:
1. I know enough about this to know it's got it wrong and no amount of kicking will make it go right (and I've kicked it a lot)
2. I didn't know enough about it, and learned the hard way that it didn't either
I've seen it be successful on toy problems but nothing even close to real (for me YMMV).
If I had a choice between 1hr on StackOverflow and 1hr on an LLM it's SO every time so far (mostly because I'll end up there anyway)