Also, I think using hosted models is strictly unethical for surveillance and energy usage reasons.
It *is* true that there are models you can run locally that are much, much more efficient, and I suspect the energy costs on training them can be dramatically reduced.
I don't use either presently, but using a local model to help you navigate a codebase (as opposed to generating code) is a very different thing, I think. But it's also not what most people are doing!
And hosted AI models, as I said, I think are fully objectionable from an ethics perspective.
Datacenters are an antipattern in the general case. AI datacenters, triply so.