Comparison
Chunking vs Contextual Retrieval
Chunking and Contextual Retrieval are both common AI/LLM terms but cover different ideas. Here is a quick side-by-side.
When you would reach for Chunking
Always — chunking is upstream of every other RAG decision. Spending 2 hours on chunking strategy commonly beats 2 weeks of prompt tuning.
A 50-page PDF split into 200-token chunks with 50-token overlap → ~150 chunks indexed.
When you would reach for Contextual Retrieval
When your corpus is large, varied, and chunks lose context when stripped from their parent document.
A legal RAG with thousands of contracts: contextual retrieval generates "Section X of Contract Y" prefixes; retrieval precision on cross-contract questions jumps materially.
Frequently asked
What is the difference between Chunking and Contextual Retrieval?
Chunking: Chunking is the process of splitting source documents into smaller passages before embedding them for retrieval. Chunk size and boundaries control how relevant retrievals will be. Contextual Retrieval: Contextual retrieval, introduced by Anthropic, prepends a model-generated context summary to each chunk before embedding — so chunks know which document and section they came from, improving retrieval precision by ~50%.
When should I use Chunking vs Contextual Retrieval?
Always — chunking is upstream of every other RAG decision. Spending 2 hours on chunking strategy commonly beats 2 weeks of prompt tuning. When your corpus is large, varied, and chunks lose context when stripped from their parent document.
Are Chunking and Contextual Retrieval the same thing?
No. Chunking is agents & tools; Contextual Retrieval is agents & tools. They are related but address different parts of the AI stack.