MRVQ: One Resident Index for Dimension- and Rate-Elastic Vector Search

AI Digest - ArXiv AI

MRVQ: One Resident Index for Dimension- and Rate-Elastic Vector Search

Dense-retrieval services must switch among embedding-prefix dimensions and index bit rates as latency, quality, and memory budgets change. Tuning a quantizer separately for each rate gives the best quality, but the retrieval tier then holds several code streams and quantizer states at once. We introduce Matryoshka Residual Vector Quantization (MRVQ), a post-hoc residual quantizer for frozen embeddings. Its maximum-rate code can be truncated two ways: dropping residual stages lowers the rate, and

Source: ArXiv AI