Skip to content
ML to LLMs
Quizzes

Attention variants

Covers the lesson Attention variants.

Quiz: Attention variants

Question 1 of 9
Calculationmedium

A 16-token sequence uses causal sliding-window attention with window w=4w = 4 (the query itself included). How many query-key cells are attended?