Preprint
Aug 2026
Giga-Embeddings: Mixture-of-Experts Encoders for High-Throughput Text Embeddings
This work introduces Giga-Embeddings, a family of text embedding models designed to combine strong retrieval quality with efficient serving, and trains the compact model using a dimension-agnostic objective that aligns teacher and student similarity distributions.
Egor Kolodin, Egor Krasnoperov, Evgeniy Kosarev et al.
· 0 citations