Quizzes
Collective operations from scratch
Covers the lesson Collective operations from scratch.
Quiz: Collective operations from scratch
Question 1 of 9
Multiple choiceeasy
How many bytes does each rank send in a ring all-reduce of a -byte tensor over ranks?