I think the basic technical problem with LLMs is that contrary to what people (including tech bros) think, the more processing power and the more source data at it, they won't get better and more intelligent.
They will just deliver ever more average results quicker.