LLM Engineering Terms Every Intern Should Know
By K. Boopathikumar, CEO & Founder · 16 November 2026 · 4 min read
In your first LLM Engineering internship meetings you will hear words that everyone else seems to know. Here they are in plain English. If you hear a term that is not on this list, write it down and ask; nobody minds an intern asking what a word means.
The terms
- Transformer: the neural network design behind modern LLMs.
- Attention: how each token weighs other tokens.
- Fine-tuning: further training a model on task-specific data.
- LoRA: fine-tuning small added weights instead of the whole model.
- Quantisation: storing weights in fewer bits to save memory.
- KV cache: stored attention data that speeds up generation.
- Evaluation set: fixed examples used to compare models.
- Inference: running a trained model to get outputs.
Next steps
- Study the free LLM Engineering learning path and take its module quizzes for a free certificate.
- Follow the LLM Engineering skill track from basic to advanced.
- Do real, reviewed work in a LLM Engineering internship and keep every project in your own GitHub.