The Unreliable Progress Bar: Can LLM Agents Reliably Report Task Progress Throughout Execution?
It is found that reporting reliability depends on the stage a task has reached, and that almost every deployed model the authors test is reliable at some stages and unreliable at others, indicating that agent frameworks should not control task flow on the strength of the model's state reports alone.