Quizzes
Attention variants
Covers the lesson Attention variants.
Quiz: Attention variants
Question 1 of 9
Calculationmedium
A 16-token sequence uses causal sliding-window attention with window (the query itself included). How many query-key cells are attended?