Skip to content

Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training

Jul 2026 · arXiv.org · Vol abs/2607.27929 · 1 citation
Computer Science

TL;DR

Meta-Task is proposed, a framework that redefines terminal task synthesis as a Terminal-Bench-format task itself: an agent operates within a real container environment to iteratively generate, execute, and verify tasks, so that synthesized components are checked for internal consistency and executability within the generation loop itself.

Abstract

Training terminal agents at scale requires diverse, verifiable terminal tasks and high-quality interaction trajectories, yet acquiring such data remains a significant challenge. Existing synthesis methods face two key limitations: (1) weak reliability caused by the disconnect between task generation and real execution, and (2) limited diversity and scalability due to dependence on existing repositories. We propose Meta-Task, a framework that redefines terminal task synthesis as a Terminal-Bench-format task itself: an agent operates within a real container environment to iteratively generate, execute, and verify tasks, so that synthesized components are checked for internal consistency and executability within the generation loop itself. Building upon this, we decouple the target task requirements along multiple dimensions, introduce a multi-phase mechanism that dynamically designs novel task specifications before producing the actual tasks, and incorporate optional external material support to enhance diversity and realism. We additionally apply LLM-as-Judge filtering to ensure the quality of the final training data. Experiments on Terminal-Bench 2.0 show that fine-tuning on only 3,221 Meta-Task synthesized trajectories achieves 22.5% and 31.8% Avg Pass@1 for Qwen3-14B and Qwen3-32B respectively, outperforming concurrent approaches with significantly less training data.

View source

Similar papers

Preprint Aug 2026

Recursive Synthesis for Long-Horizon Terminal Tasks

Recursive Synthetic Terminal Tasks (RST) is presented, a recursive verified synthesis framework for constructing long-horizon terminal-agent tasks at scale and shows no ceiling, indicating that the process can continue well beyond the scale reported here.

Zhongzhi Li, Yucheng Shi, Zongxia Li et al. · 5 citations
Jul 2026

AgentOmnia: Scaling Agentic Models for Full-Scenario Applications

A one-round study provides initial evidence for PRD-guided self-evolution, motivating validation at larger scales and in industrial settings, and presents AgentOmnia, a framework coordinating task-space definition, data synthesis, post-training, evaluation, and improvement across To-Consumer (ToC), To-Business (ToB), a...

Hao Jiang, Gang-Tao Xin, Ying Huang et al. · 0 citations
#artificial intelligence Preprint Aug 2026

UI-Venus-2 Technical Report

UI-Venus-2 is presented, a general-purpose foundation GUI agent designed to operate across mobile, web, and desktop environments through a unified closed-loop reasoning-action framework that integrates safety-aware mechanisms to ensure controlled execution of consequential actions.

Venus Team, Zhuo-Hang Cai, Hao-Xin Chen et al. · 3 citations
#artificial intelligence Preprint Aug 2026

FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Production

Experiments show that FRAMEWORKERS outperforms strong LLM planners in routing accuracy, recovers reliably from runtime failures, generalizes to unseen sub-agents without retraining, and achieves higher end-to-end video quality and broader task coverage than fixed pipelines, single-agent systems, and prior multi-agent a...

Zhen-Dong Li, Lei Sun, Le-Tian Shi et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.