Koa-action: Fast and Consistent Structured Decision Making with Generative LLMs
Koa-action is a framework for low-latency atomic actions -- fast, single-step decisions such as classification, semantic endpointing, Boolean checks, and scoring -- formulated as constrained generation with single-token outputs by introducing atomic label tokens and applying supervised fine-tuning.
Sheng-Hong Dai, S. Pentyala, Ying-Chi Liu et al.
· 0 citations