Skip to content
Conference Open access

Beyond Pipeline Mimicry: Expert-level Aesthetic ISP via Reward-Guided Flow

Sep 2026 · Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence · pp. 1559-1567 · 0 citations · 37 references

TL;DR

This work proposes AesISP, the first expert-level aesthetic ISP framework formulated as a reward flow model, and establishes a Privileged Prior Distillation paradigm, and introduces a multi-dimensional reward-driven reinforcement learning approach.

Abstract

Recent deep learning-based ISP methods are primarily constrained by mimicking fixed camera pipelines, consequently struggling to achieve expert-level aesthetic quality. To this end, we propose AesISP, the first expert-level aesthetic ISP framework formulated as a reward flow model. Addressing the ill-posed nature of ISP, AesISP establishes a Privileged Prior Distillation paradigm. By leveraging expert-image-guided latent proxies, we decompose the intractable task into a tractable, proxy-driven learning process. Subsequently, we propose MeanFlow++, which reformulates the flow matching objective via target-prediction parameterization and a Progressive Temporal Curriculum. By evolving from learning instantaneous to long-range average velocities, this mechanism rectifies transport trajectories and uses deterministic mapping to impose explicit constraints, anchoring the generation trajectory to the expert manifold. Finally, we introduce a multi-dimensional reward-driven reinforcement learning approach.Leveraging Group Relative Policy Optimization (GRPO) to balance trade-offs across dimensions such as color and lighting, it steers the model to converge precisely on expert-level aesthetic standards. Experiments demonstrate that AesISP outperforms state-of-the-art methods in both quantitative metrics and aesthetic quality.

Read PDF

Similar papers

Preprint Oct 2026

VideoAWR: Reinforcing Video Flow Models with Decoupled-Timestep Advantage-Weighted Rectification

Regression-based RL for flow models mandates sampling \emph{without} classifier-free guidance (CFG) to align the rectification target with the reference marginal velocity. Extending Advantage-Weighted Rectification (AWR), which dynamically scales this regression target based on reward, to video generation encounters a...

Zhe-Ming Fu, Wen-Bin Ning, R.-Z. He et al. · 0 citations
Preprint Sep 2026

Joint Alignment and Distillation for Video Generation via Sample-Guided Distribution Matching

DM-Align is introduced, which derives a complementary gradient direction to guide the model toward human-preferred samples, and eliminates the need for multi-step reward evaluation and complex ODE-SDE conversions inherent in traditional RL.

Jiu-Zhou Lin, Jun-Long Wu, Feilong Zuo et al. · 1 citation
Preprint Aug 2026

Aligning Human Sense: Calibrated Distributional Reward Learning for Video Generation

Video generation is central to AI-powered content creation. Aligning generated videos with human preferences is a key criterion for evaluating generation quality. Despite significant progress in visual quality, three key challenges remain. First, the reliability of reward signals is constrained by the quality of human...

Nai-Xin Zhai, Weihua Cheng, De-Xu Yu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modeling

RewardVerse, a rubric-based video reward framework that introduces a dynamic rubric as an intermediate representation between the evaluation query and the scorer, mitigates scalar drift, and provides a robust and interpretable reward signal for RL in video generation.

Zhen-Chen Tang, Yang Li, Songlin Yang et al. · 1 citation
#machine learning Preprint Aug 2026

Reward-guided Fine-Tuning of One-Step Generative Models via Wasserstein Gradient Flow

This work considers one-step generators from an optimal transport view, investigating Wasserstein Gradient Flow (WGF) for modeling smooth and controlled distributional evolution in probability space, and proposes a novel reward-guided fine-tuning of a one-step generative model via WGF.

Hoseong Hwang, Woorim Han, Joungin Chun et al. · 1 citation
Preprint Oct 2026

FASTER: Fast Adjoint Stochastic Transport for Endpoint Refinement in Reward-Guided Image Editing

Reward-guided image editing at test time seeks to improve a specified reward while preserving source content and visual plausibility. Many existing approaches optimize candidates through pretrained generation processes, making repeated adjustment depend on costly large-model execution and, in some cases, backbone backp...

Yi-Miao Zhou, Ze-Jia Zhong, Jing-Ya Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.