AURA-Eval: Evaluation Framework for Acting Under Risk Awareness in LLM Agent Trajectories
AURA-Eval, a framework combining controlled augmentation with granular diagnosis of behavior in tool-use trajectories, is introduced, showing that LLM agents engage in unsafe behavior more often when no safe fulfillment path exists.
Ruoxi Shang, Christina-Maria Androna, Orfeas Menis-Mastromichalakis et al.
· 0 citations