Adaptive Residual Correction Network for Efficient Single Image Super-Resolution

Abstract

In recent years, vision transformers have demonstrated remarkable superiority to CNNs in single image super-resolution (SISR), yet their heavy computational and storage costs hinder practical deployment. In this work, we revisit CNN-based residual learning for SISR and identify a specific yet overlooked problem: the residual signal is often biased by mapping errors during model training, and this bias can propagate and accumulate through layers. To this end, we revisit the commonly used residual learning and feature fusion in SISR and propose an adaptive residual correction network (AdaRCN) in this work. First, we introduce a residual correction mechanism that adaptively compensates for the bias in the residual, which is utilized to ease error accumulation and improve mapping accuracy. On the other hand, we generalize the standard identity shortcut to a weighted channel concatenation followed by a 1 × 1 convolution, which is a more versatile strategy for adaptive feature fusion. Our AdaRCN is built entirely upon a naive CNN without complex architecture design and training strategies, thus ensuring efficient inference and parallelization. Extensive experiments verify the benefits and effectiveness of residual correction and adaptive feature fusion in improving the representational capability of our model, enabling it to achieve impressive performance comparable to advanced SISR models with moderate overhead.