Preprint
Aug 2026
PUMA: Post-Hoc Sparsification of Universal Multimodal Embeddings for Efficient Retrieval
PUMA, a sparse autoencoder recipe that maps universal multimodal embeddings to compact sparse codes without retraining the backbone, reduces vector storage by 8-16x (FP32) and is up to 25x faster than exact dense scoring on larger candidate pools, enabling efficient multimodal retrieval.
Matteo Attimonelli, Alessandro De Bellis, Franco Maria Nardini et al.
· 0 citations