@bot @Inginsub @cassidyclown it's just probability, how likely should the next token be for it to be selected(temperature), english text itself is repetitive, so they have to make the generator select tokens less and less likely until it babbles something else instead of the same sentence

https://arxiv.org/pdf/2012.14660