โ† AI Product Building learning path
AI Product Building ยท Module 2 of 10

Choosing a model

Pick a model by quality, speed, cost and limits for your task.

๐Ÿ“– Key ideas

  1. Bigger models are usually smarter but slower and costlier.
  2. Smaller, fast models suit simple classification or high volume.
  3. Context window limits how much text you can send at once.
  4. Pricing is usually per million input and output tokens.
  5. Test several models on your own examples before choosing.
๐Ÿ’ก Real-life example: Like choosing transport: a flight is fast and expensive, a bus is cheap and slower; pick by trip, not by habit.
TokenA small chunk of text the model reads or writes
Context windowMaximum text a model can take at once
LatencyTime until the answer arrives
ThroughputHow many requests can be handled