Aug 2026· 2026 IEEE 22nd International Conference on Automation Science and Engineering (CASE)· pp. 1920-1927· 0 citations· 24 references
Computer Science
TL;DR
The proposed MedVLA is a hierarchical framework that couples high-level multimodal reasoning with lowlevel function-constrained execution for deployable precision medical robotics, and demonstrates the effectiveness of the proposed framework across model variants.
Abstract
Precision medical robotics demands adaptive decision-making under strict safety, interpretability, and execution constraints. Although recent Vision-Language-Action (VLA) models show strong multimodal reasoning ability, their continuous action generation paradigm is not well suited for precision medical tasks, where reliable closed-loop operation may also depend on non-action system function calls. To address this gap, we propose MedVLA, a hierarchical framework that couples high-level multimodal reasoning with lowlevel function-constrained execution. We further introduce a scalable multi-agent pipeline to generate skill-oriented chainof-thought(CoT) data for structured training. Built on different multimodal large-model backbones, MedVLA consistently improves performance after fine-tuning, demonstrating the effectiveness of the proposed framework across model variants. Under identical initial conditions, we perform 100 closed-loop flexible electrode implantation trials. The results show that MedVLA achieves a 95.0% task success rate, substantially outperforming representative VLA baselines, including OpenVLA (8%) and $\pi_{0}$ (15%), in accuracy, stability, and safety. These results indicate that structured reasoning with constrained function-level execution is a practical route toward deployable precision medical robotics.
This work proposes MobileVLA-R1 2.0, an RL-enhanced VLA framework that explicitly couples structured embodied reasoning with executable mobile robot control, and introduces a reasoning-conditioned action decoder that maps multimodal reasoning representations to task-level action targets, which are subsequently translat...
Ting Huang, Yue Huang, Ze-Yu Zhang et al.· 1 citation
NebulaVLA is presented, an asynchronous dual-frequency architecture that decouples high-level semantic reasoning from low-level action control, optimizing computational resources and modularity and introduces GESTURE-7, a unified language-grounded action representation.
Congyu Zhao, Shuai Tian, Xu Zhang et al.· 0 citations
Recent multimodal large language models (MLLMs) and vision--language--action models have provided robots with new capabilities for long-horizon task understanding and planning. In surgical robotics, however, end-to-end prediction of low-level actions remains limited by insufficient precision, opaque decisions, and scar...
An-Gen Ye, Jun-Jie Xie, Yu-Jia Song et al.· 0 citations
MotorMind is introduced, a robot manipulation harness that connects VLM-proposed mid-level actions to deterministic robot control and feedback, with asynchronous monitoring and background memory updates, and shows that a general-purpose VLM, when equipped with an appropriate mid-level action representation and asynchro...
Results indicate that augmenting a fixed pretrained VLA backbone with explicit temporal and structured perceptual intermediate information provides a practical and effective way to improve robotic manipulation.
Pei-Sen Huang, Jian-Hua Hu, Jie-Ren Deng et al.· 2026 IEEE 22nd International...· 0 citations
Experimental results in various task scenarios show that the proposed framework consistently improves overall task success rates compared with unimodal settings with different LLMs and achieves a higher success rate compared to using only visual or force data.