... cont'd 2/5
Recent findings like these suggest at least two possibilities for why emergence occurs.
1. In comparison to biological systems larger models truly gain new abilities spontaneously.
2. What appears to be emergent may instead be the culmination of an internal, statistics-driven process that works through chain-of-thought-type reasoning. Large LLMs may simply be learning heuristics that are out of reach for those with fewer parameters or lower-quality data.
...