Skip to content
Preprint

MotionCanvas: Learning Implicit Motion Planning from Composable Kinematic Cues

Sep 2026 · 0 citations · 52 references
Computer Science

Abstract

Professional character animation requires both natural motion and precise, versatile control. For example, it is common for the creators to define the timing of a specified action, to control the motion range of the character's arm swing, and the route the character walks through, like specifying various kinematic motion cues on a ``motion canvas''. This motivates us to propose MotionCanvas, a model that supports \emph{cue-conditioned implicit motion planning} to faithfully and coherently connect all cues, dense or sparse, full or partial, into one full-body motion sequence. Specifically, MotionCanvas represents heterogeneous kinematic cues on a shared motion canvas, where position and rotation values are specified across body joints and time. A shared flow-matching model generates motion conditioned on this canvas, with optional language and input motion; cue imputation keeps the specified canvas values fixed in both training and sampling. To learn coherent completion across different cue sets, we train with a compositional cue sampler that varies when cues are applied, which positions or rotations are specified, and how they are combined. Together, these designs enable a single generator to synthesize globally coherent actions that jointly satisfy compatible heterogeneous cues. We test this planning ability with temporal, root, and body-part cues---alone and in combination---and language-guided editing. We naturally extend this evaluation to sequential generation and motion repair, since both require the same ability to organize coherent motion from kinematic cues. Across these evaluations, MotionCanvas establishes state-of-the-art results in controlled-motion quality, mixed-cue adherence, sequential generation, instruction editing, and motion repair while preserving its text-to-motion capability.

View source

Similar papers

HIGenNTO: Scalable Humanoid Interaction Generation via Noise-Space Trajectory Optimization

HIGenNTO is presented, a framework that synthesizes humanoid-scene interaction motion references by optimizing the initial noise of a pretrained text-conditioned motion model under sparse spatiotemporal and scene constraints, establishing a scalable path from high-level task descriptions to physically executable humano...

Lalit Jayanti, Kashu Yamazaki, Yuto Shibata et al. · 0 citations
Preprint Sep 2026

Dense Temporal Motion Retargeting for Legged Robots

Legged robots can learn expressive whole-body skills from the motions of humans and animals. Due to the morphology gap between the source and the robot, however, the motion must be tailored to the dynamic properties of the robot. In particular, dynamic motions such as a jump require careful adjustment, since their timi...

Jaeryeong Kim, Taerim Yoon, Jin Cheng et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Generative Cinematographer: Composing Camera and Object Motion in 3D

Current controllable video generation systems often rely on 2D motion trajectories or sparse drag signals for object motion. These controls are ambiguous because the same 2D trajectory can correspond to different 3D motions, especially when the camera and objects move simultaneously. We present Generative Cinematograph...

Jia-Han Zhang, Chao-Hao Yang, N. Guruprasad et al. · 0 citations
Sep 2026

CHOREO: Every Humanoid Skill as a Trajectory

CHOREO, a framework for training-free composition of heterogeneous humanoid skills, demonstrates that executable trajectories provide a scalable interface for accumulating and composing pretrained humanoid capabilities.

Zi-Yi Sun, Jing-Wen Chen, Yu-Xin Wang et al. · 1 citation · ⚡1
#artificial intelligence Preprint Oct 2026

MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing

Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Beyond general scenarios, professional motions are significant in performance, sports, and martial arts. This paper focuses on professional motion editing, which involves fi...

Si-Yi Qian, Han-Qing Yang, Wei-Huang Lin et al. · 0 citations
Preprint Aug 2026

4DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation

4DSynth is presented, a controllable procedural system that turns a natural-language description, a blueprint mask, or a single photograph into an editable 4D environment with explicit geometry, animated actors, collision-free trajectories, and physics-ready simulation state.

Ze-Hao Qi, Hao-Chen Luo, Jia-Wang Bian et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.