USAI-Quant: A Quantitative Reasoning Benchmark for Vision-Language Models in Built Environments
The USAI-Quant benchmark is developed, the first benchmark designed to quantitatively evaluate VLM's reasoning capabilities on built environment metrics via remote sensing imagery, and reveals that current state-of-the-art models consistently fall short on numeric reasoning tasks.