Industry applications often demand low-latency classification, yet current large language model (LLM) approaches remain poorly suited for latency-critical applications. Existing prompting and constrained decoding produce verbose, multi-token outputs that require expensive token-by-token generation, while encoder-based...
Sheng-Hong Dai, S. Pentyala, Ying-Chi Liu et al.· 1 citation
AgentScript-Eval is introduced, an execution-graded benchmark of 100 real tasks for AgentScript, the declarative DSL that Salesforce uses in Agentforce to build conversational agents.
Dipin Khati, Shubham Mehrotra, Bin Bi et al.· 0 citations
Koa-action is a framework for low-latency atomic actions -- fast, single-step decisions such as classification, semantic endpointing, Boolean checks, and scoring -- formulated as constrained generation with single-token outputs by introducing atomic label tokens and applying supervised fine-tuning.
Sheng-Hong Dai, S. Pentyala, Ying-Chi Liu et al.· 0 citations
We present Salesforce Koa, an enterprise language model built by post-training the open-weight Nemotron-3-Super-120B foundation model with reinforcement learning using Group Relative Policy Optimization (GRPO), and deployed in FP8 for production. Koa is trained only on public and synthetically generated data, and speci...
Zi-Xiang Chen, Su-Feng Niu, Ying-Chieh Liu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.