← Blog
Chunking
Data/dictionary/chunking
Definition
Splitting a document into smaller pieces before embedding it, so retrieval can pull back just the relevant piece instead of the whole document.
Posts that use this term
- Evals: how you actually know it got better
Feeling better isn't the same as measurably better. Offline eval sets, LLM-as-judge, human eval, and regression testing for prompts and RAG pipelines.
- RAG done right: chunking and retrieval mechanics
Naive RAG breaks in practice long before the model does. Chunking strategy and embedding choice decide most of it, and here's where top-k search quietly fails.