Skip to content
ML to LLMs
Quizzes

The transformer architecture

Covers the lesson The transformer architecture.

Quiz: The transformer architecture

Question 1 of 6
Calculationmedium

How many parameters (with biases) does a feed-forward sublayer have with d=256d = 256 and dff=1024d_{\text{ff}} = 1024?