@FrailLeaf @feld @rees @Zerglingman @NEETzsche @Moon

First would be anything niche. There are a billion guides on how to build a site with React, it follows LLMs will be good with web dev stuff. When it's something niche (there are a million niche fields) that's where they falter; there is relatively less text regarding the topic.

Second would be anything low level (hardware, embedded, operating systems, compilers, databases). They require debugging on a level an LLM will probably never do. What if the hardware has a hidden bug, or the CPU has undocumented behavior? What if there's a miscompilation? If you write an optimized ASM routine it still has to be tested on real hardware.