Quizzes
Tokenization and pretraining
Covers the lesson Tokenization and pretraining.
Quiz: Tokenization and pretraining
Question 1 of 6
Calculationeasy
The model assigns probability 0.25 to the actual next token. What is the cross-entropy for that token (natural log, 3 decimals)?