โ† Artificial Intelligence & Machine Learning learning path
Artificial Intelligence & Machine Learning ยท Module 6 of 10

Model evaluation

Measure model quality correctly.

๐Ÿ“– Key ideas

  1. Confusion matrix: TP, FP, TN, FN.
  2. Accuracy, precision, recall, F1 score.
  3. ROC curve and AUC for ranking quality.
  4. Cross-validation gives reliable estimates.
  5. Overfitting: great on training, poor on test.
๐Ÿ’ก Real-life example: Evaluating a model is grading an exam: not just total marks, but which questions were wrong.
PrecisionCorrect positives among predicted positives
RecallFound positives among actual positives
F1 scoreBalance of precision and recall
Cross-validationRotating train/test folds