what temperature actually does

Temperature divides the model's raw scores before they become probabilities. Low means the top choice wins almost every time. High means the long tail gets a chance.

I made a toy for it in the workshop. Slide it and sample a few times.