Reference · Glossary
Embedding batch
Grouping many texts into **one embeddings API job** (or batch endpoint) instead of one call per row.
When to use
Nightly index builds with thousands of chunks.
When not to
Single interactive query embed — latency matters more than batch discount.
Example
Submit 10k chunks as one batch job; poll until complete; upsert vectors to the index.