Skip to content
ML to LLMs
Quizzes

Collective operations from scratch

Covers the lesson Collective operations from scratch.

Quiz: Collective operations from scratch

Question 1 of 9
Multiple choiceeasy

How many bytes does each rank send in a ring all-reduce of a TT-byte tensor over NN ranks?