Reference · Glossary

Embedding batch

Grouping many texts into **one embeddings API job** (or batch endpoint) instead of one call per row.

#When to use

Nightly index builds with thousands of chunks.

Single interactive query embed — latency matters more than batch discount.

Submit 10k chunks as one batch job; poll until complete; upsert vectors to the index.