Aditya Ramabadran

DrivingBench: Can Vision-Language Models Drive a Toyota Corolla?

This work presents DrivingBench, to its knowledge the first benchmark where general-purpose vision-language models must drive a real car, and details the design principles behind the action interface, and shows how the tool output format and the framing of the task combined to determine whether models would drive at al...