Why it exists

Before selecting the next token, the model's final neural net layer assigns a raw numerical confidence score to all ~100k vocabulary tokens.

How it works

Logits pass through a Softmax function to turn raw scores into probabilities summing to 1.0. Temperature and top-p sampling scale logits prior to Softmax.