@sun @santiago thing is that they already tried making the models bigger, and it turns out that this doesn't actually make the results better.
I expect that the effort going forward is going to be largely on the software side with figuring out better algorithms and how to get reliable and repeatable results.
The business model OpenAI was pursuing is dead now.