← Blog
Epoch
ML/dictionary/epoch
Definition
One full pass through the training dataset. Most large models are trained for less than a single epoch on a dataset so big that one pass is enough.
Posts that use this term
- Fine-tuning a model locally
When fine-tuning is actually the right call (it usually isn't) and how to pull off a LoRA run on a 16GB Mac, with a worked Llama 3.2 3B example.
- How a model learns: training and inference
Training is the expensive one-time event where a model's numbers get tuned. Inference is the cheap repeated use afterwards. The gap in cost is enormous, and it shapes the whole industry.