← Back to Glossary
Semantic Chunking
Splitting text wherever topic meaning shifts (detected via embedding distance drops) rather than arbitrary token counts.
Why it exists
Fixed-size chunking can break a single thought across two chunks. Semantic chunking keeps complete ideas together.
How it works
Calculates embedding distances between consecutive sentences. When semantic distance spikes above a threshold, a new chunk boundary is formed.
Related terms
Where you'll use this
roadmap