Emergent Abilities of Large Language Models Emergence can be defined as the sudden appearance of novel behavior. Large Language Models apparently display emergence by suddenly gaining new abilities as they grow. Why does this happen, and what does this mean? Figure: As Transformer language models are scaled, they gain abilities in an emergent fashion. Modified from source (modified from [1]). [1] https://arxiv.org/abs/2206.04615
https://files.mastodon.social/media_attachments/files/110/945/465/068/258/476/original/b896ba3b9c050fdf.png