AI Learning Express
Platform 01 · Station 7 of 10

Next-token probabilities

01 · Watch / read

Probability means chance. After The sky is, imagine these chances for the next token: blue 55%, gray 30%, clear 15%. A model can choose using these chances. This is called sampling. It does not always choose the biggest chance. These numbers are made up for this example.

Choose from next-token chances

The sky is …blue55%gray30%clear15%One possible choice: gray
Made-up chances · The biggest chance is not always chosen.

After The sky is, invented probabilities are blue 55 percent, gray 30 percent and clear 15 percent. Sampling may choose any of these, including gray.

02 · Try

Which token could be chosen using these chances?

Choose one answer

Progress saves in this browser.