Skip to content
ML to LLMs
Learning path

Module 2

The end-to-end ML workflow

Frame, collect, explore, split, baseline, train, evaluate, deploy, monitor, without leaking the answer.

  1. 1. Workflow, splits, and leakageRun the ML loop from framing to monitoring, split data the way production will differ, build baselines, and find leakage before it finds you.35 min
  2. 2. Overfitting and the bias-variance trade-offDiagnose underfitting and overfitting from training and validation error, understand bias and variance, and pick model complexity with validation curves.30 min

A model is one step of a loop. Most production failures come from the other steps: a split that doesn't match deployment, a feature that leaks the future, a metric that ignores the cost of errors, or no monitoring after launch.

StepKey questionDeliverable
1. FrameWhat decision and metric matter?problem statement
2. CollectIs the data representative and permitted?versioned dataset
3. ExploreWhat is missing, skewed, duplicated, or leaked?EDA report
4. SplitHow will future data differ?train / validation / test sets
5. BaselineWhat does a simple rule achieve?reference score
6. TrainWhich pipeline and model?reproducible experiment
7. EvaluateWhere and why does it fail?error slices
8. DeployHow is inference served?API or batch job
9. MonitorHas data or quality drifted?alerts and dashboards
#LessonYou will be able to
1Workflow, splits, and leakagechoose random, time, or group splits and find leakage
2Overfitting and the bias-variance trade-offdiagnose under- and overfitting from training and validation curves
Next moduleModule 3: Regression