Skip to content

AerialDojo-200K: A Large-Scale Benchmark Suite for Open-World Aerial Object-Goal Search

Sep 2026 · 0 citations · 17 references
Computer Science

TL;DR

A large-scale benchmark suite for open-world aerial object-goal search, with 3 times as many scenes and 18.7 times as many task instances as the largest existing benchmark for this task, and a unified evaluation framework with a unified evaluation framework.

Abstract

Open-world aerial object-goal search is a foundational yet challenging task, requiring aerial agents to autonomously explore large-scale, unstructured three-dimensional environments and reach target objects specified by semantic descriptions or reference images, rather than following route-specific instructions. However, research in this task remains at a nascent stage and relies on small, environment-specific benchmarks with heterogeneous action spaces and data formats. These limitations hinder large-scale training and cross-benchmark evaluation, constraining the scalability and generalizability of aerial agents. To address this problem, we propose AerialDojo-200K, a large-scale benchmark suite for open-world aerial object-goal search, with 3 times as many scenes and 18.7 times as many task instances as the largest existing benchmark for this task. Specifically, we construct 42 simulation scenes spanning four scene families and 21 scene types, including 18 urban, 12 natural, six infrastructure, and six disaster scenes. To ensure data quality, 12 annotators spent two months manually annotating 109 landmarks, 2099 target objects, and 2099 object anchors across these scenes. We further construct 205,732 task instances, comprising over 100K semantic-goal and over 100K image-goal instances across Base, Standard, and Long-Horizon settings. Each task instance includes a collision-free reference trajectory and corresponding multi-view video recordings. We also develop a unified evaluation framework with a scene partition comprising 21 in-distribution scenes and 21 out-of-distribution scenes. Finally, our evaluation of five open-source and four closed-source multimodal large language models reveals that there is still a long way to go toward achieving general-purpose aerial agents. All can be found at https://fengtt42.github.io/AerialDojo/.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Method

AGOS-Bench is introduced, the first dedicated benchmark for evaluating whether general-purpose Vision-Language Models (VLMs) can integrate aerial discoveries and ground-level verification through UAV-UGV cooperation, and AGOS-Agent is proposed, a training-free and tool-augmented approach to address the AGOS task.

Bokyung Yu, Zi-Mo Chen, Jun-Reng Rao et al. · 3 citations · ⚡1
Preprint Aug 2026

AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoning

By systematically revealing the strengths and limitations of existing models in aerial-ground collaborative reasoning, AeroGround provides a foundation for developing more capable aerial-ground collaborative embodied intelligence systems.

Shenghong Yi, Lin Zhang, Muzian Li et al. · 0 citations
Preprint Sep 2026

SatNav: A Scalable Benchmark for Long-Horizon UAV Vision-Language Navigation from Satellite Imagery

SatNav, a scalable, long-horizon UAV VLN benchmark built from high-resolution satellite imagery, is introduced and satellite-to-UAV transfer experiments show that satellite-trained navigation models can operate on real-flight UAV observations, showing the practical relevance of SatNav.

Jia-Jun Jiang, Chun-Liang Hua, Zi-Chun Chen et al. · 0 citations
Preprint Aug 2026

Advancing MLLM-based UAV Image Understanding and Reasoning: A Benchmark and a Training-Free Multi-Agent System

UAV-MAS is proposed, a training-free multi-agent system for MLLM-based UAV aerial image understanding and reasoning, comprising a Domain-Specific Perception Engine that routes queries to task-appropriate visual tools, a Context-Aware Iterative Refinement module (CAIR) that validates intermediate reasoning to curb error...

Hao-Yu Zhang, Shuoxun Zhang, Peng Ye et al. · 0 citations
Oct 2026

GAS-Robo: Converting Scene Into a Grid-Action Space for LLM-Driven Open-Ended Robotic Manipulation

Generalizing to out-of-distribution scenarios remains a major challenge for traditional robotic manipulation methods trained on closed datasets. Recent approaches leveraging foundation models have significantly improved zero-shot capabilities by utilizing vision-language models, yet many of these methods treat the foun...

Han-Xuan Li, Sen-Wei Xie, Ze-Tao Lin et al. · 0 citations
Preprint Sep 2026

RoboFolDeX: A Physical-World Benchmark for Long-Horizon Robotic Manipulation of Deformable Objects

RoboFolDeX is introduced, a physical-world benchmark built entirely from real-robot data, with garment folding as its primary task, and a fair real-robot evaluation platform for externally submitted policies, with standardized tasks, held-out physical objects, controlled initializations, and a unified execution protoco...

Chen-Huan Liu, Yi Xu, Feng Wu et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.