FogTTA is introduced, an online test-time adaptation framework designed to improve the robustness of Transformer-based object detectors in fog, using RF-DETR as the underlying object detector and following a teacher-student design.
Abstract
Object detection models for autonomous driving commonly experience substantial performance drops when deployed under adverse weather due to the domain shift between training data and real-world operating conditions. This degradation is especially evident when models trained on clear-weather images encounter foggy environments with reduced visibility and contrast. To address this challenge, we introduce FogTTA, an online test-time adaptation framework designed to improve the robustness of Transformer-based object detectors in fog. Using RF-DETR as the underlying object detector, FogTTA enables real-time adaptation to the streaming target domain without requiring source data or retraining. The framework follows a teacher-student design, where the deployed model serves as the teacher and generates pseudo labels from weakly augmented target inputs. These predictions are subsequently refined through non-maximum suppression and confidence filtering. The student model then learns from strongly augmented target sample using the Varifocal loss to mitigate pseudo-label noise. The teacher is updated via exponential moving averaging to ensure stable and continuous adaptation. Experiments show that FogTTA outperforms prior baselines, delivering improved detection accuracy and stability while maintaining real-time performance.
Autonomous driving perception systems must maintain reliable object detection under diverse environmental conditions, not only in clear daytime scenes. However, the cross-weather robustness of modern detectors remains insufficiently characterised under source-only evaluation. This study evaluates representative object...
Munshaibur Rahman Mahin, Isha Das, M. Islam et al.· 0 citations
Adverse weather attenuates fine-grained target cues, disrupts cross-scale feature propagation, and weakens long-range contextual dependencies in UAV imagery, making the detection of small and partially occluded objects particularly challenging. Existing state-of-the-art detectors for adverse weather are typically t...
Foggy weather poses a significant challenge for object detection in autonomous vehicles due to degraded visibility. To improve the visual quality, existing methods make efforts to jointly learn image restoration and object detection tasks. However, training a restoration subnet requires pixel-corresponding image pairs,...
Zheng-Cai Cao, J. Niu, Chi Zhang et al.· IEEE Transactions on Automat...· 0 citations
In adverse weather conditions such as fog, haze, rain, and snow, unmanned aerial vehicle (UAV) small object detection faces decreased accuracy due to reduced image quality and blurred object features, which seriously affects the reliability of low-altitude detection tasks. To address this challenge, this paper proposes...
Yang Zhang, Guang-Fei Li, Bin Zhou· Scientific Reports· 0 citations
This work proposes a novel context-aware multimodal late fusion approach that integrates a lightweight gating network within the probabilistic calibration framework and dynamically modulates the detection outputs of pre-trained object detectors based on the inferred context, without retraining of the detectors.
Arunachalam Venkatachalam, Mhafuzul Islam, M. Yusuf et al.· 0 citations
Robust visual instance segmentation for autonomous maritime surface vehicles remains challenging under adverse weather conditions such as fog and rain, which can cause contrast attenuation, boundary blurring, and visual interference. To address these challenges, we propose WADNet, a weather-adaptive instance segmentati...
Yu-Xin Sun, Lu Zhang, Zeng-Yan Zhu et al.· Journal of Marine Science an...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.