ColNanoVDR is presented, to the authors' knowledge the first framework to bring this document-free distillation to multi-vector VDR, and it is proved that the resulting alignment cost bounds the MaxSim score difference on every page.
Zhu Liu, Zi-Yi Wang, Yao Zhang et al.· 0 citations
This work presents DistilVDR, a 524M end-to-end VDR system distilled bilaterally from a single 8B vision-language teacher under a pointwise cosine alignment loss and matches VDR's text-query and image-document input asymmetry with an asymmetric encoder-only student that concentrates visual capacity on the document side...
Zhu Liu, Zi-Yi Wang, Yao Zhang et al.· 0 citations
NanoVDR exploits query--document asymmetry by decoupling the two encoding paths: a frozen 2B VLM teacher indexes documents offline, while a distilled text-only student as small as 69M parameters encodes queries at inference, and the resulting NanoVDR-S-Multi (DistilBERT, 69M) retains 95.1% of teacher quality.
Zhu Liu, Yao Zhang, Yuntian Xiao· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.