- DepartureAI basics
- Stop 2Learning from examples
- Stop 3Prompts
- Stop 4Tokens
- Stop 5Embeddings
- Stop 6Attention
- Stop 7Next-token probabilities
- Stop 8Repeated generation
- Stop 9Temperature
- ArrivalChecking answers
Platform 01 · Station 6 of 10
Attention
Attention helps a model use useful words from the text around it. In Maya put her book away, Maya helps us understand her. Some sentences are still unclear, and the model can make mistakes.
Context helps connect words
In Maya put her book away, a highlighted connection links her to Maya. Nearby words help the model. The colours and lines are only a teaching example.
02 · Try
In “The train stopped at the station because it needed repairs,” does “it” clearly mean the train?
Progress saves in this browser.