Are We There Yet? Assessing Computer-Use Agents for Blind Users'Accessible Interaction with Desktop Applications
A three-week diary study with 8 blind users using OLLA, a screen-reader-accessible CUA prototype, collecting 1,258 commands across 12 applications with screenshots, UI trees, model responses, and action traces reveals grounding, planning, constraint-tracking, and termination failures, while interviews reveal beyond-aut...
Satwik Ram Kodandaram, Monalika Padma Reddy, Xiaojun Bi et al.
· 0 citations