Skip to content

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

UBTree: Parallel Tree Drafting via Unigram and Bigram Models for Speculative Decoding

Speculative decoding accelerates language model inference by verifying multiple draft tokens in a single target-model pass. Recent parallel drafters have achieved breakthrough performance in frontier production models, but their effectiveness deteriorates as the entropy of target distributions increases due to insuffic...

Chumeng Liang, Lin-Xuan Wang, Xin-Yu Peng et al. · 2 citations

SQS: Bayesian DNN Compression through Sparse Quantized Sub-distributions

A unified framework for simultaneous pruning and low-bit quantization via Bayesian variational learning via Bayesian variational learning is introduced, which achieves higher compression rates than prior baselines while maintaining comparable performance.

Ziyi Wang, Nan Jiang, Guang Lin et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.