Do Tool Calls Execute as Intended? Measuring and Repairing Intent-Execution Correspondence in LLM Agents
IEC-Bench is built from the changes observed in real-world use, with chains of dependent calls under the execution paths of 4 widely-used harnesses, and intent-execution correspondence (IEC) is defined as the property that the executed action matches the action the emitted call denotes under the tool contract.
Bo-Yang Yang, Zhen-Hao Li, Zi-Yao Yang et al.
· 0 citations