Skip to content
ML to LLMs
Quizzes

Tokenization and pretraining

Covers the lesson Tokenization and pretraining.

Quiz: Tokenization and pretraining

Question 1 of 6
Calculationeasy

The model assigns probability 0.25 to the actual next token. What is the cross-entropy for that token (natural log, 3 decimals)?