Author

Sai-Bo Geng

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#natural language process... Preprint Oct 2026

zip2zip++: Towards Inference-Time Token Compression with Minimal Quality Loss

Dynamic vocabularies built on-the-fly via Lempel-Ziv-Welch (LZW) compression let a language model represent the same text in fewer tokens, but prior work shows that this efficiency comes at a cost to reasoning and perplexity. We show that this quality gap is not a fundamental price of compression but can be substantial...

Sai-Bo Geng, A. Gentilini, Xin-Xian Ma et al. · 0 citations

#machine learning Preprint Sep 2026

EchoPress: Query-Agnostic KV Cache Pruning via Virtual Context Reconstruction

KV cache pruning reduces long-context inference memory usage by evicting less important key-value pairs. KVzip estimates importance through context reconstruction: prompting a model to repeat the context chunk by chunk. This achieves strong compression quality at the cost of additional forward passes. Learned approxima...

Jia-Wei Lin, Sai-Bo Geng, Thomas Bourgeat · 1 citation