Preprint
Aug 2026
Dynamic Multi-Byte Prediction With Hierarchical Language Models
It is shown that multi-byte prediction strikes a Pareto-optimal trade-off across multiple generative tasks, instruction following, question answering, summarization, and machine translation, achieving the best trade-off between performance and inference throughput.
Abraham Toluwase Owodunni, C. Okocha, Christan Grant et al.
· 0 citations