Asynchronous flow map language models (aFMLMs), which incorporate prediction order into one-step modeling by learning the flow maps of asynchronous flows, are introduced, which can generate all tokens in a single forward pass by internalizing the ordering encoded in the flow into their hidden computations.
Chanhyuk Lee, Wonjung Kim, Patrick Pynadath et al.· 0 citations
Continuous flow language models offer a path to parallel generation with tools for control and acceleration unavailable to discrete diffusion, yet effective techniques for building them at the billion-parameter scale remain less established. We present Lafa (Large flow language model), a fast, high-performing flow lang...
Arnav Chavan, Chanhyuk Lee, Udbhav Bamba et al.· 1 citation
Recently, Drifting Models and Wasserstein Gradient Flows have attracted substantial attention because they move iterative distributional refinement to training and amortize it into a generator, enabling fast inference. However, existing formulations have been developed largely for continuous Euclidean domains, such as...
David Li, Chanhyuk Lee, Jaehoon Yoo et al.· 0 citations
Long-context inference with Large Language Models (LLMs) is bottlenecked by the linearly growing memory of the key-value (KV) cache. Existing compression methods reduce the cache through token eviction or approximation, but degrade sharply at aggressive compression budgets. We propose PatchKV, a training-free framework...