Skip to content

When to Adapt: Multi-Signal Domain Shift Detection for Efficient Training-Free Adaptation in Open-Vocabulary Segmentation

Sep 2026 · arXiv.org · Vol abs/2609.37602 · 0 citations · 27 references
Computer Science

TL;DR

This work proposes a multi-signal domain shift detection method for training-free continual test-time adaptation (TF-CTTA) in open-vocabulary segmentation that maintains segmentation accuracy while substantially reducing adaptations, making training-free adaptation practical and feasible for long-term, real-world robotic deployments.

Abstract

Robust and reliable perception is essential for autonomous robots operating in real-world environments, particularly in long-term missions where environmental conditions may change significantly over time. Although recent advances in Visual Foundation Models (VFMs) have improved open-vocabulary semantic segmentation, these models can still suffer from domain shift, which can significantly degrade performance if they are not adapted to the current environment. Training-free domain adaptation is a relevant paradigm for adaptation, consisting of adjusting the model online using lightweight adapters. Recent approaches apply this on a per-frame basis, which is impractical for deployments on resource-constrained robotic hardware. To tackle this, we propose a multi-signal domain shift detection method for training-free continual test-time adaptation (TF-CTTA) in open-vocabulary segmentation. Our method leverages temporal coherence across consecutive frames by monitoring and combining complementary aspects of domain shift (visual change, adapter mismatch, and semantic drift) to trigger adaptation only when needed. We validate our approach on a benchmark including indoor and outdoor environments and using real robotic data. We demonstrate that our approach maintains segmentation accuracy while substantially reducing adaptations, making training-free adaptation practical and feasible for long-term, real-world robotic deployments.

View source

Similar papers

Preprint Nov 2026

Training-Free Active Test-Time Adaptation for Vision-Language Models

Test-time adaptation (TTA) for vision-language models (VLMs) is usually studied in a fully unsupervised regime, where adaptation relies on pseudo-labels, confidence scores, or entropy computed by the model itself. This is a severe restriction on hard shifted samples: the model is asked to repair its own uncertain predi...

Jihwan Bang, Sumyeong Ahn, Hwanjun Song et al. · 0 citations
Book Open access Nov 2026

Spherical Consistency and Test-time Adaptation for Open-Vocabulary Audio-Visual Event Localization

Open-Vocabulary Audio-Visual Event Localization (OV-AVEL) requires models to localize audio-visual events while predicting explicit categories for events unseen during training. Current baselines adopt a text-centered pairwise modality decision strategy. However, it lacks unified modeling of multimodal semantic consist...

Bo-Han Su, Sheng-Lan Liu, Chi Liu et al. · 0 citations
Nov 2025

HENet++: Hybrid Encoding and Multi-task Learning for 3D Perception and End-to-end Autonomous Driving

Three-dimensional feature extraction and multi-task perception are fundamental components of modern autonomous driving systems. Although large image encoders, high-resolution inputs, and long temporal contexts can substantially improve representation quality and overall performance, jointly leveraging these strategies...

Zhong-Yu Xia, Zhi-Wei Lin, Yong-Tao Wang et al. · 6 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.