Embed Notice

@futurebird @dahukanna @PavelASamsonov why? because that’s not exactly what they’re doing. as you scale up model size, new capabilities emerge, things they weren’t trained to do. “emergent behavior” isn’t a theory, it’s an observation. the open question is, what other sorts of capabilities will emerge when we scale further up. will they acquire an element of surprise? idk, i’d say no but i’ve also been wrong so far about what their limits should be