Embed Notice

@mario
Because I don’t have a background it’s hard to get a handle on how LLMs work and what processes they go through.
I have heard a presentation that talked about how expert training didn’t produce as good a result as just increasing the size of the LLM (what GPT4 did).
Leaving aside factual accuracy. Going from a single sentence question prompt to several paragraphs of a plausible answer in good English through a program is frankly amazing.