@clacke one admission: I don't use copilot. I use Claude where I ask it questions and followup questions and it gives me link references back to where it got its information.

I have found a few things it's not good at. One example is there is a popular library in the cryptocurrency space that you use to make a webpage interact with a smart contract. There are three major versions of it in common use, versions 4, 5 and 6. The guides are constructed in such a way that I think it's difficult for AI scraper to extract which version is being documented, and example code just uses the library name. Guides online to use it frequently don't even tell you which version they are using. The three versions are SUBSTANTIALLY different.

When I ask for help, the code it generates often is a mishmash of the three versions and will in no way work. I found that I could struggle with the AI for a long time and still not get even close to correct code. So I had to abandon it for that particular library. The reason I needed AI even though the libraries are documented is that the documents are not very good. They give you a big list of modules and functions and tell you very vaguely what they do, but then don't accurately describe what functions you have to call to instantiate those objects so they are usable. they frequently don't give you the types of parameters or return values.