Skip to content
#small language model Open access

Implicit semantic control manifolds for learning-enabled multi-UAV coordination

Sep 2026 · Autonomous Robots · Vol 50 · 0 citations · 69 references

TL;DR

This work presents an embodied visual-communication approach in which bio-inspired motion–LED glyphs are represented by a reduced six-parameter semantic chart embedded within a full 24-dimensional hybrid execution manifold.

Abstract

Unmanned aerial vehicle (UAV) swarm agents operating in radio-frequency (RF)-degraded environments require coordination mechanisms that connect directly observable signals to executable responses. This work presents an embodied visual-communication approach in which bio-inspired motion–LED glyphs are represented by a reduced six-parameter semantic chart embedded within a full 24-dimensional hybrid execution manifold. A learned translator large language model (LLM) maps a perceived glyph to a response that is instantiated as an executable trajectory and propagated through closed-loop quadrotor dynamics. The system is evaluated in 200 three-UAV search-and-rescue trials with receiver-specific degradation from sensing range, field of view, occlusion, and relative motion. Under clean observations, the quantized small model and rule-based translator both achieve 100%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$100\%$$\end{document} semantic correctness, but under single- and two-parameter corruption, the quantized small model achieves 64.7%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$64.7\%$$\end{document} and 64.1%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$64.1\%$$\end{document}, compared with 44.8%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$44.8\%$$\end{document} and 35.2%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$35.2\%$$\end{document} for rule-based, while reducing mean multi-agent trajectory error from 2.902m\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2.902~\textrm{m}$$\end{document} to 0.993m\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$0.993~\textrm{m}$$\end{document}. All methods maintain 100%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$100\%$$\end{document} rotor-allocation and finite-horizon feasibility. The quantized small model also has comparable overall semantic correctness with the large model (83.3%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$83.3\%$$\end{document} vs. 86.3%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$86.3\%$$\end{document}) while dropping latency from 5.115s\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$5.115~\textrm{s}$$\end{document} to 2.789s\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2.789~\textrm{s}$$\end{document} and is validated onboard a Jetson–Pixhawk UAV platform, where airborne inference and bounded command execution produce measurable physical motion. These results establish a unified pathway from degraded visual observation to semantically meaningful, dynamically grounded UAV coordination.

Read PDF

Similar papers

Preprint Sep 2026

Learning-Based Dynamic Obstacle Avoidance for a UAV Using Only Three Range Sensors

We present a learning-based approach to kinodynamic online motion planning for an Unmanned Aerial Vehicle (UAV) operating at a fixed altitude in unknown dynamic environments, where real-time avoidance of both static and dynamic obstacles must be achieved under conditions of extreme partial observability. The UAV is con...

Mohammad Reza Ranjbar Divkoti, A. Aguiar · 0 citations
Review Open access Sep 2026

Large Language Models for UAV Autonomy from a Perception–Cognition–Action Perspective

Deployable autonomy remains a key challenge for unmanned aerial vehicles (UAVs) operating in open-ended missions. Large language models (LLMs) and their multimodal variants, which can process visual and other sensory inputs, have introduced new capabilities for semantic perception, task reasoning, and language-conditio...

Ting-Quan Xiong, Jianning Zhan, Qiu-Wei Deng et al. · 1 citation
Preprint Sep 2026

VLM-MPPI: Grounding Natural Language in Behaviorally Diverse Trajectories for Aerial Navigation

A hierarchical UAV navigation framework that aligns natural-language intent with dynamically feasible flight behaviors in cluttered indoor environments is presented, and a parallelized ensemble of six behavior-conditioned Model Predictive Path Integral (MPPI) planners are employed.

Hanbing Zhang, Fang-Guo Zhao, Ze-Rui Li et al. · 0 citations
Preprint Sep 2026

VIRGA: Virtual-Agent-Intermediated Riemannian Geometry for Active-Sensing Air-Ground Coordination

Air-ground autonomy becomes harder when the unmanned aerial vehicle (UAV) must remain observable by a gimbal light detection and ranging (LiDAR) mounted on the unmanned ground vehicle (UGV). The platforms must avoid dynamic obstacles while coordinating heterogeneous motion, limited sensing, and changing task initiative...

Feng-He Guo, Run-Jie Shen, Chen-Yang Sun et al. · 0 citations
Preprint Aug 2026

PILOT: Privileged Imitation Learning for End-to-End Motion Planning of Autonomous UAVs under Partial Observability

PILOT, a constraint-aware privileged imitation learning framework for vision-based end-to-end UAV motion planning under partial observability, is presented, demonstrating the practical feasibility and cross-domain generalization of the planner.

Qing-Rui Zhang, Feng Xue, Xiang Zhou et al. · 0 citations
Open access Aug 2026

SkyAgent: A lightweight LLM-driven reinforcement learning framework for adaptive cooperative path planning of two UAVs

This work provides a feasible technical pathway and reproducible evaluation benchmark for the collaborative deployment of lightweight LLM planner, sub-goal guidance, sensor observations, cooperative reward, and reward shaping components and quantifies the indispensability of the LLM planner.

Yuting Cao, Zheng Zhao, Jiekai Wu et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.