Skip to content
Open access

HiPA-Gen: Hierarchical Interaction Perception and Alignment for High-Fidelity Pose-Guided Human Generation

Aug 2026 · Electronics · Vol 15, pp. 3851 · 0 citations · 15 references

TL;DR

Qualitative results show that the proposed HiPA-Gen framework produces clearer limb boundaries, more reliable spatial ordering, and more consistent clothing textures in challenging pose interaction scenarios.

Abstract

Pose-guided human image generation aims to synthesize an image of a target person based on a reference image and a target pose. Although diffusion-based methods have recently achieved significant progress in pose alignment and visual realism, generating high-fidelity images in regions involving complex pose interactions remains a challenge. Typical issues include structural confusion of limbs and texture distortion in occluded areas. To address this challenge, this paper proposes the HiPA-Gen framework, which is designed to automatically perceive complex interaction regions and generate high-fidelity content within them. Unlike existing methods that mainly rely on flat skeleton conditions or implicit attention responses, HiPA-Gen explicitly models hierarchical spatial relations and local appearance priors in complex interaction regions. Specifically, we design a Dual-Agent Hierarchical Reasoning Module (DHR) where a Prompt-Guided Reasoning Agent identifies interaction-related body parts and a Hierarchical Rendering Agent converts the inferred relations into a Hierarchical Correspondence Pose (HCP) map. The HCP map provides explicit front–back structural cues for limb overlap, hand occlusion, and body self-occlusion. To further reduce local texture ambiguity, we introduce a Part Prior Detail Alignment Module (PDA), which extracts Regional Reference Assets (RRAs) from the source image under HCP-guided part priors. These regional references are then injected into the Pose-Conditioned Interaction-Aware Detail Synthesis Network (PDS) through a Local Enhancement Branch (LEB), enabling more accurate local feature fusion during diffusion-based synthesis. Experiments on DeepFashion and Market-1501 show consistent numerical improvements under the reported evaluation protocols in structural similarity, perceptual quality, and distributional fidelity. Qualitative results further show that the proposed framework produces clearer limb boundaries, more reliable spatial ordering, and more consistent clothing textures in challenging pose interaction scenarios.

Read PDF

Similar papers

Preprint Sep 2026

LEGAU: Learning Semantic Gaussian Priors for Scalable Category-level Pose Estimation

Category-level 6D pose estimation from a single RGB-D observation is inherently under-constrained, since partial visible geometry must be interpreted together with a canonical object structure before a stable pose can be determined. We present LEGAU, a unified framework that jointly predicts NOCS correspondence, object...

Hong-Li Xu, Zhao-Wei Lu, Jun-Wen Huang et al. · 0 citations
Preprint Oct 2026

ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image

Embodied agents benefit from 3D environments that combine visual fidelity to real-world observations with physical interactivity. Existing single-image tabletop reconstruction methods recover plausible scene geometry but typically represent objects as monolithic rigid bodies, limiting interaction to whole-object rigid...

Kai Lv, Yi-Bo Yin, Li-Jun Guo et al. · 0 citations
Preprint Sep 2026

CoBrush: A Hierarchical Planning Framework for Human-Robot Co-Painting

Embodied co-painting requires a robot to repeatedly update a shared physical canvas while human intent evolves over interaction. Existing reference-driven painters or reactive assistants are typically optimized for single-shot rendering or sketch completion, limiting their ability to sustain coherent multi-round collab...

Dan-Tong Qin, Yi-Ke Guo, Qin-Lin Liu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

WeLike2Party! In-Context Motion Transfer for Multi-Human Image Animation

Human image animation aims to transfer motion from a driving video to subjects in a reference image. Despite remarkable progress in video generation, achieving high-fidelity animation of multiple interacting subjects remains a challenge. Many existing approaches rely on explicit motion representations such as 2D skelet...

Sangeyl Lee, Seunghyun Shin, S. Park et al. · 0 citations
Preprint Sep 2026

Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning

Fysiverse-3D-Vision is proposed, a unified vision-language-geometry framework for generative 3D scene reconstruction and executable asset construction from a single image that establishes a shared representation where spatial reasoning and geometric reconstruction mutually enhance each other, allowing object layouts to...

Ding-Kang Yang, Yi-Zhou Liu, Wen-Dong Cheng et al. · 0 citations
Preprint Sep 2026

GRC-Pose: Generation-Reconstruction Correspondence for Prior-Free 6D Object Pose Tracking

GRC-Pose is introduced, a correspondence-based framework that combines learned correspondence prediction with robust pose estimation and achieves state-of-the-art Average Recall and motion retention on HOT3D, improving the latter by 58% over prior art.

Shi-Yang Liu, Wei-Quan Lin, Lu-Ping Xiao et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.