Multimodal large language models (MLLMs) answer questions about whole images well, yet they still struggle with fine-grained region understanding. A key reason is that text-only supervision never specifies which regions support an answer. To close this gap, we present Xiaomi-Lens-0, a 4B MLLM built on Qwen3.5 that pred...
OmniStepBench is introduced, a benchmark for deployment-aware agent evaluation across modalities and task complexity, and its findings support deployment decisions based on workload profiles, deployment mode, and accuracy--cost trade-offs rather than a single aggregate score.
Yu Liu, Zhi-Lin Liu, Zhi-Wei Yang et al.· 0 citations
DAREBench (Deployment-Aware and Reliable Evaluation of Models as Agents), a benchmark designed to capture workload variation and support reliable agent evaluation, is introduced, suggesting that agent deployment and model selection should consider workload profiles, deployment mode, and accuracy--cost trade-offs rather...
Yu Liu, Zhi-Lin Liu, Zhi-Wei Yang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.