Skip to content

Unified Text-Image Generation with Weakness-Targeted Post-Training

Jan 2026 · arXiv.org · Vol abs/2601.04339 · 1 citation · 29 references
Computer Science

TL;DR

This work explores post-training to achieve fully unified text-image generation, where a model autonomously transitions from textual reasoning to visual synthesis within a single inference process, and enables improvements in multimodal image generation across four diverse, independent T2I benchmarks.

Abstract

Unified multimodal generation architectures that jointly produce text and images have recently emerged as a promising direction for text-to-image (T2I) synthesis. However, many existing systems rely on explicit modality switching, generating reasoning text before switching manually to image generation. This separate, sequential inference process limits cross-modal coupling and prohibits automatic multimodal generation. This work explores post-training to achieve fully unified text-image generation, where a model autonomously transitions from textual reasoning to visual synthesis within a single inference process. We study this on BAGEL, a 14B mixture-of-transformers model that pairs autoregressive text generation with flow-matching image synthesis. We examine the impact of joint text-image generation on T2I performance and the relative importance of each modality during post-training. We additionally explore different post-training data strategies, showing that a targeted dataset addressing specific limitations achieves superior results compared to broad image-caption corpora or benchmark-aligned data. Using offline, reward-weighted post-training with fully self-generated synthetic data, our approach enables improvements in multimodal image generation across four diverse, independent T2I benchmarks, demonstrating the effectiveness of reward-weighting both modalities and strategically designed post-training data.

View source

Similar papers

Preprint Aug 2026

Exploring the Performance Frontier of Compact Unified Image Generation Models

Swift-Image achieves leading aggregate performance among evaluated open-source models with only 6B parameters and 243K GPU training hours; the compressed 3B model incurs nearly no loss, while few-step distillation further improves aggregate editing performance with substantially fewer sampling steps.

Taihang Hu, Zhaowen Wang, Zuan Gao et al. · 2 citations · ⚡1
Open access Aug 2026

Structured Creative Evaluation for Text-to-Image Generative AI Models

A multi-dimensional image quality assessment framework for T2I tasks that can not only distinguish overall performance differences across models, but also provide interpretable results at the level of individual dimensions is proposed.

W.-C. Ma, Q. Zhang · 0 citations
Preprint Oct 2026

Self-correction Optimization for Interleaved Multimodal Generation

Multimodal large language models (MLLMs) have made significant progress in visual understanding and generation. However, generating interleaved image--text content remains challenging, as it requires tightly integrated multimodal understanding and generation capabilities. Although existing MLLMs provide promising solut...

Xin You, Zhi-Wei Ning, Zu-Kai Chen et al. · 0 citations
#artificial intelligence Preprint Oct 2026

APT: Feedback-Driven Agentic Post-Training for Text-to-Image Generation

Post-training is crucial for improving text-to-image models, yet existing pipelines typically rely on manually curated training data and fixed training distributions. We introduce APT (Agentic Post-Training), a fully automated framework that adaptively post-trains a base model according to its evolving capability profi...

Si-Rui Zhang, Fang-Yun Wei, Dong Chen et al. · 0 citations
#artificial intelligence Preprint Oct 2026

ReasonUni: Reasoning-Augmented Reconstruction Advances Unified Multimodal Models

Image-to-text (I2T) understanding and text-to-image (T2I) generation are dual tasks in unified multimodal models (UMMs). Reconstructive post-training couples these tasks, but existing reconstruction-based methods remain perception-centric and provide limited supervision for reasoning about structure, intent, and transf...

Fei-Ze Wu, Zhi-Yuan Yan, Yuri Hong et al. · 0 citations
Sep 2026

TIC: Co-optimization of training and inference for efficient image-text retrieval.

This work proposes a Training-Inference Co-optimization (TIC) framework that systematically enhances both stages of the retrieval pipeline, and achieves state-of-the-art performance among embedding-based techniques, significantly outperforming strong baseline models-even when utilizing a more lightweight text encoder.

Zhong-Xiang You, Shi-Yuan Yang, Zhi-Xin Li · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.