Embed Notice

@pixxl @thomasfuchs But it does, by weighting the probability of the token it will select at any given step towards 100% (at 0 T): https://techscribr.github.io/posts/llm-temperature/

But I don't think the average person who knows what an LLM is would agree that "the LLM algorithm is just the bit that spits out vector weights" when every implementation out there includes the sampler.