MonitorVLM-v2 is presented, a deployment-oriented framework that recasts VLM-based safety assessment as probabilistic inference over a finite regulatory decision space, compressing multimodal reasoning into single-step rule-ID predictions and reducing decoding from a variable-length sequence to a single token.
Abstract
Large vision--language models (VLMs) can reason step by step about complex visual scenes, but this open-ended, autoregressive chain-of-thought (CoT) approach is poorly suited to safety-critical, rule-governed settings such as industrial surveillance, where decisions must be bounded, deterministic, and low-latency. Because CoT inference cost scales jointly with reasoning length and the number of concurrent streams, it creates a throughput bottleneck that precludes the real-time, multistream monitoring required for industrial accountability. Here we present MonitorVLM-v2, a deployment-oriented framework that recasts VLM-based safety assessment as probabilistic inference over a finite regulatory decision space, compressing multimodal reasoning into single-step rule-ID predictions and reducing decoding from a variable-length sequence to a single token. We introduce symbolic policy optimization (SymPO), a novel contrastive policy optimization algorithm that sharpens decision boundaries within this finite symbolic space, together with an entropy-driven triage mechanism that routes uncertain predictions to human reviewers for expert confirmation. In a four-month prospective deployment across 10 concurrent camera feeds in an operational underground mining facility, MonitorVLM-v2 achieved a 19.45-fold increase in inference speed and identified 2.78 times as many confirmed violations as the site's routine manual inspection workflow, demonstrating the practical value of compressed symbolic decision-making for real-time, auditable industrial monitoring.
A teacher-student knowledge distillation framework in which large VLMs fine-tuned for fire understanding can be distilled into lightweight students is developed, which provides broader guidance for deploying domain-specialized VLMs in resource-constrained, safety-critical settings.
Mohammad Kazzazi, Zi-Xuan Liu, S. Khajavi· 0 citations
FlashDrive is proposed, an algorithm-system co-design framework that targets all four stages of Vision-Language-Action inference simultaneously and moves end-to-end autonomous driving substantially closer to real-time deployment.
Ze-Kai Li, Yihao Liang, Hong-Fei Zhang et al.· 2 citations
Reflex is presented, a framework that enables real-time streaming inference for flow matching policies by exploiting the Timestep-Invariance Property -- that perception encoders are functionally independent of the denoising loop.
VerNav, a verifier-first framework for low-latency LLM-based VLN, achieves competitive navigation performance among representative LLM-based VLN agents while reducing average decision-stage LLM latency per step by more than $10\times$ compared with autoregressive methods.
Zhi-Xin Wang, Chengzheyi Yao, Le-Yuan Liu et al.· 1 citation
Autonomous vehicles (AVs) operate in complex environments where failures are consequential. Sophisticated machine learning models for perception and planning are key to overcoming at least part of that complexity, but their black-box nature complicates validation and verification (V&V). The recent integration of Vision...
Tianwen Yu, Lu Feng, Sebastian G. Elbaum· 0 citations
The Language Residue taxonomy is introduced to organize methods by their inference-time use of language: train-time-only supervision, latent non-textual reasoning, conditional invocation, and full per-frame generation.
Tong-Fei Guo, Lili Su· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.