Skip to content
ML to LLMs
Quizzes

Self-attention

Covers the lesson Self-attention.

Quiz: Self-attention

Question 1 of 8
Calculationmedium

Scaled scores for one query are [ln⁡3,  0][\ln 3,\; 0]. What attention weight goes to the first key? (Hint: eln⁡3=3e^{\ln 3} = 3.)