Confidence scores determine whether an LLM answer is accepted, reviewed, or regenerated, yet scalar recalibration can only correct errors visible through the score itself. We introduce RADAR (Repair, Adopt, and Diagnose After Recalibration), a reliability framework that separates confidence repair from deciding whether...
Arijit Dey, Bhartendu Kumar, Ramya Hebbalaguppe et al.· 0 citations
LLM systems increasingly rely on groups of agents that discuss, critique, and check one another, assuming that peers will catch individual errors. We test this assumption against a minimal adversary. In a ten-agent factual discussion, one or three adversarial agents repeatedly assert a plausible false answer. After eac...
Liangjie Huang, Henry Peng Zou, Wei-Chieh Huang et al.· 0 citations
Multimodal Large Language Models (MLLMs) achieve strong performance through instruction tuning, yet real-world applications often require them to continually acquire new capabilities from sequential tasks, i.e., Multimodal Continual Instruction Tuning (MCIT). In typical MLLMs, a projector is employed to align visual re...
Ling-Xiang Zhang, Tao Hu, Da-Wei Zhou· 0 citations
Key-value (KV) cache management has become a critical bottleneck for scaling Large Language Models (LLMs) to long-context scenarios due to linear memory growth. While recent eviction methods have moved beyond simple attention-score heuristics to incorporate value representations, they typically face a fundamental trade...
Ao-Zhong Zhang, Selcuk Gurses, Yan-Xia Deng et al.· 1 citation
Reach audiences
Advertise in front of researchers, engineers, and readers.
Modern agentic systems extend language models with external tools, enabling them to complete complex tasks through multi-turn interactions. As these agents are deployed in consequential settings, they are often constrained by policies governing pricing, privacy, confirmation, safety, and other requirements. However, ex...
Kshitij Mishra, Abhijith Sharma, Nils Lukas et al.· 0 citations
A language model can generate several solutions to the same problem, some leading to correct answers and others to incorrect ones. Many post-training methods turn these trajectories into learning signals using supervision from reference answers, verifiable feedback, or external teachers. Without such supervision, learn...
Feiyang Chen, Runze Ma, Zichen Wang et al.· 0 citations
Multimodal large language models (MLLMs) can act unsafely when individually benign images and texts are interpreted jointly. Beyond implicit reasoning risk, where reasoning drifts toward harm, we identify intent-level risk, where cross-modal ambiguity silently commits the model to a hazardous premise that path-level op...
Wei Cai, Jian Zhao, Yu-Chen Yuan et al.· 0 citations
Given a state and a set of options, such as intents, tools or interface elements, System One decision models return a distribution over the options in one forward pass, without generated reasoning. Web systems increasingly build them by reading decisions from language models. Two axioms of rational choice are natural r...
Yao Long Teng, Jianguo Huang, Yanchen Deng et al.· 0 citations
Organizations increasingly encode operational procedures as multi-step agent skills, here called Agent Operating Procedures (AOPs), that must be traceable, auditable, reproducible, access-controlled, and bounded in time and cost, requirements that regulated sectors make mandatory. Yet AOPs are typically kept as coarse-...
Ali Mohammadi Shanghooshabad (JPMorgan Chase, Co.)· 0 citations
Traditional reinforcement learning (RL) algorithms face significant limitations in handling long-term tasks with sparse rewards. Recent advancements have leveraged large language models (LLMs) to enhance RL by utilizing their world knowledge for task planning and reward generation. However, planning-based approaches of...
Xiuhui Zhang, Ning Gao, Xingyu Jiang et al.· 0 citations
Behavioral consistency across repeated executions provides an informative signal for assessing the reliability of large language model (LLM) agents. However, existing approaches typically summarize consistency with a single task-level score, without identifying where behavioral differences occur or whether actions are...
Ya-Xin Ma, Wen-Bo Zhang, Satya K. Pothapragada et al.· 0 citations
Retrieval-augmented generation over text-rich knowledge graphs requires identifying evidence that contributes to answering a question, rather than merely matching its textual content. Existing agentic retrievers adaptively balance global search and multi-hop exploration but primarily rely on textual similarity to guide...
Wei-Chen Liu, Xiang-Cheng Wu, Depeng Xu et al.· 0 citations