Skip to content

AeroManip-VLA: Scalable Vision-Language-Action Learning for Aerial Manipulation with RL-Generated Demonstrations

Sep 2026 · 0 citations · 26 references
Computer Science

TL;DR

This work presents AeroManip-VLA, a scalable benchmark for aerial VLA data generation and policy evaluation, and evaluates a range of imitation learning and VLA baselines across different task settings, revealing their performance characteristics and failure modes.

Abstract

Aerial manipulators extend robotic manipulation into 3D workspaces that are difficult for ground-based robots to access, creating new opportunities for general-purpose manipulation. However, extending Vision-Language-Action (VLA) models to aerial robots introduces distinct challenges due to the tight coupling between manipulation and flight, continuously changing observations, and safety-critical physical interactions. These challenges demand diverse training data and systematic policy evaluation, yet collecting demonstrations and evaluating policies directly on physical aerial platforms are costly, difficult to scale, and hard to repeat under controlled conditions. We present AeroManip-VLA, a scalable benchmark for aerial VLA data generation and policy evaluation. AeroManip-VLA provides a GPU-accelerated simulation framework with low-level payload-aware flight and manipulation control in massively parallel environments. Building on this framework, we combine reusable reinforcement learning policies with expert task rules to automatically generate demonstrations without human teleoperation across diverse objects, environments, and randomized initial conditions. The generated data include basic skills such as grasping and placing, as well as long-horizon tasks that require both navigation and manipulation. We further introduce automated event labeling and trajectory categorization to filter demonstrations. These mechanisms enable fine-grained analysis of task progress, behavioral outcomes, and safety-related failures. Finally, we evaluate a range of imitation learning and VLA baselines across different task settings, revealing their performance characteristics and failure modes. Together, AeroManip-VLA enables scalable aerial manipulation data generation, structured trajectory analysis, and systematic VLA evaluation in simulation prior to real-world deployment.

View source

Similar papers

Conference Aug 2026

Vision-Language Guided Aerial Manipulation for Autonomous UAV Grasping

Unmanned aerial vehicles (UAVs) equipped with manipulators enable aerial interaction tasks such as object pickup and transport in environments that are difficult for ground robots to access. However, reliable autonomous aerial grasping remains challenging due to limited onboard perception, dynamic flight conditions, an...

Vuppu Venkata Sai Viswa Kiran, Aashish Sahu, Siddanth Bhogoju et al. · 0 citations
Preprint Sep 2026

MotorMind: Scaffolding General Vision Language Models for Zero-Shot Robot Manipulation

MotorMind is introduced, a robot manipulation harness that connects VLM-proposed mid-level actions to deterministic robot control and feedback, with asynchronous monitoring and background memory updates, and shows that a general-purpose VLM, when equipped with an appropriate mid-level action representation and asynchro...

Bing-Xuan Li, Si-Qi Song, Yi-Zhuo Wu et al. · 0 citations
#robotics Preprint Sep 2026

RoboTalk: Learning Multi-Robot Communication and Coordination from Multimodal Demonstrations

RoboTalk is introduced, a synthetic data-generation pipeline and dataset of 7,950 multimodal trajectories spanning 53 mobile-manipulation kitchen tasks for training small VLMs to communicate and coordinate and fine-tuning open-source models on this dataset can reach 77% success on novel held-out tasks.

Dorian Benhamou Goldfajn, Mason Nakamura, Saaduddin Mahmud et al. · 0 citations
#machine learning Preprint Sep 2026

GT-VLA: Target-Conditioned Trace Guidance for Generalizable Robotic Manipulation

Vision-Language-Action (VLA) models have shown strong performance on robotic manipulation, but they often struggle to generalize to unseen tasks, configurations, and long-horizon settings. A key challenge is that VLAs overfit to training scenes and fail to follow novel language instructions. Off-the-shelf vision-langua...

Ning-Han Zhong, Jing-Chen Peng, Sriram Vishwanath · 0 citations
Preprint Oct 2026

WareFly-VLA: A Vision-Language-Action Framework for UAV Navigation and Human Tracking in Smart Warehouses

Vision-Language-Action (VLA) models have achieved impressive results in robotic manipulation and ground-mobile navigation, yet language-conditioned control of unmanned aerial vehicles (UAVs) in smart warehouses remains largely unexplored, hindered by the lack of benchmarks that jointly provide continuous low-level flig...

Thinh D. Le, Son Nguyen, Duong Q. Nguyen et al. · 0 citations
Preprint Aug 2026

EXIMO: VLM Guided Exploration of VLA Policies

How to efficiently finetune robot policies to learn new tasks on the fly? State of the art robotic manipulation policies are based on behaviour cloning of large vision-language-action (VLA) models with billions of parameters on huge teleoperation datasets. While this simple approach has enabled significant advances for...

Bhavya Sukhija, Oliver Groth, Mohit Shridhar et al. · 1 citation

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.