Turning up the temperature
At any given step a language model has one fixed set of raw scores (logits) over its vocabulary — temperature is the dial that reshapes them, deciding whether it commits to the top token or spreads its bets. Drag it from cold to hot and watch the distribution melt from a spike to a flat field, while the samples raining below follow along. Built in p5.js.
p5.jsinteractivemlllmsampling