Skip to content

Asynchrony-Robust Cooperative Perception and Prediction via Continuous-Time Global State Evolution

Oct 2026 · IEEE Robotics and Automation Letters · Vol 11, pp. 11322-11329 · 0 citations · 33 references

Abstract

Vehicle-to-everything (V2X) collaboration can alleviate the limited perception range and occlusion issues of single-agent autonomous driving. However, most existing cooperative studies still focus on single-frame perception, while the few works on joint cooperative perception and prediction largely rely on fixed-step, frame-aligned fusion, making them difficult to apply in realistic systems with cross-agent temporal misalignment. To address this issue, we propose CoSPACE, a novel framework that formulates asynchronous cooperative perception and prediction as continuous evolution and event-triggered correction of a shared scene state. Specifically, CoSPACE maintains an ego-centric global BEV state and propagates it to arbitrary observation timestamps using an ODE-style dynamics model, thereby preserving temporal coherence under irregular multi-agent inputs. When asynchronous observations arrive, they are treated as local evidence and assimilated by an event-triggered update module, which first selects informative regions and then performs time-aware gated correction to adaptively incorporate temporally reliable evidence. With this design, CoSPACE moves beyond the conventional frame-aligned fusion paradigm and mitigates the spatial misalignment, semantic confusion, and prediction degradation caused by temporal asynchrony. Experiments on V2XPnP-Seq under diverse delay settings show that CoSPACE consistently outperforms representative baselines and achieves strong robustness in asynchronous cooperative perception and prediction.

View source

Similar papers

Preprint Aug 2026

CoAnchor: Robust Collaborative Perception under Spatio-Temporal Misalignment via Object-Level Anchors

Collaborative perception extends the sensing range of a single vehicle by fusing observations from nearby agents, which improves the robustness of autonomous driving. In realistic deployments, however, the received collaborator messages are often affected by both communication delay and relative-pose noise, which jointly cause stale observations, spatial misalignment, and unstable feature fusion. Existing methods usually address these issues from either the spatial or temporal side, but handling them jointly in a unified and efficient manner remains challenging. In this paper, we propose CoAnchor, an anchor-centric spatio-temporal alignment framework for asynchronous collaborative perception. Instead of directly reasoning on dense BEV features, CoAnchor builds sparse object-level spatio-temporal anchors as a shared interface for pose correction and tightly connects spatial refinement, temporal propagation, and current-time verification within one unified loop, while keeping the overall correction process lightweight. Extensive experiments on both simulated and real-world datasets illustrate that CoAnchor remains competitive under clean settings and improves the robustness under joint delay and pose perturbations with a favorable practical accuracy-efficiency trade-off.

Chirong Li, Ruifeng Lin, Aobo Ji et al. · 0 citations
2026

Hybrid State Space Modeling for Sequence-Based Robot Localization Under Challenging Environments

Visual localization is vital for autonomous systems but remains challenging under dynamic conditions. Transformers offer strong temporal modeling at quadratic cost, while CNNs are efficient yet limited in long-range dependencies. Existing methods also lack robustness to illumination, weather, and seasonal changes, constraining real-world applicability. To address this, this paper proposes AdapseqNet, a dual-branch architecture that integrates stabilized state-space modeling with differential temporal enhancement. First, a stabilized state-space formulation featuring Lyapunov-constrained parameterization and adaptive discretization is proposed, ensuring asymptotic stability and linear computational complexity for reliable processing of extended sequences. Second, a selective Mamba architecture is developed to combine temporal-state modeling with content-aware gating, enabling adaptive feature selection that emphasizes discriminative cues while suppressing redundancy. Third, a differential enhancement module is designed to extract motion-invariant representations through symmetric temporal differencing and LSTM-based refinement, enhancing resilience to appearance variations caused by lighting, weather, and seasonal changes. Beyond architectural design, multi-scale feature fusion and output distribution control are incorporated to optimize representation quality and ensure consistency for similarity-based retrieval. Extensive experiments on multiple benchmarks demonstrate that AdapseqNet achieves a better localization accuracy across diverse and challenging conditions. Note to Practitioners—Visual localization is crucial for autonomous robots but often fails under varying lighting, weather, or seasonal conditions. We propose a dual-path approach: one path captures long-term patterns using control-inspired stable modeling, while the other extracts motion cues that remain consistent despite appearance changes. This combination enables accurate place recognition even in extreme environments. Our system operates efficiently on standard hardware and was tested on an indoor robot, achieving centimeter-level accuracy. This approach can enhance existing navigation systems without requiring additional sensors. Future work will focus on real-time optimization for outdoor deployment.

Zhenyu Li, Tianyi Shang · 0 citations
Preprint Aug 2026

Towards Collaborative Joint Perception and Prediction: Framework, Baseline Evaluation, and Deployment Perspectives

Connected Autonomous Vehicles (CAVs) increasingly exploit Vehicle-to-Everything (V2X) communication to exchange multi-source sensor information, enabling advanced Collaborative Perception (CP) capabilities. Extending beyond these capabilities, this work focuses on Collaborative Joint Perception and Prediction (Co-P&P), a paradigm that unifies CP with motion prediction to mitigate two persistent challenges: the accumulation of perception errors and visual occlusions. We present a conceptual framework for Collaborative Joint Perception and Prediction (Co-P&P) that improves motion prediction of surrounding road users, thereby enhancing situational awareness in complex and dynamic traffic environments. Building upon our preliminary study, this extended version compares the performance of different fusion strategies and establishes baseline performance for a modular design of perception and prediction. Experimental results show that prediction-level fusion leads to a decline in overall system performance compared to detection-level or tracking-level fusion. We further implement a minimal end-to-end Co-P&P prototype that couples collaborative point-cloud sharing via the RENO neural codec with joint detection-forecasting via FutureDet, showing that collaboration improves forecasting accuracy while neural compression preserves this benefit at roughly 34x lower communication bandwidth.

Lei Wan, Hannan Ejaz Keen, Alexey V. Vinel · 0 citations
Oct 2026

MaTF: Maneuver-Aware Temporal Fusion for Trajectory Prediction Under Arbitrary Observation Length

Trajectory prediction is essential for many robotic applications, yet most existing models rely on fixed-length observations and struggle with temporally irregular inputs. In real-world settings, prediction difficulty further increases when agents exhibit strong maneuverability, as their future motions depend on distinct short-term and long-term temporal cues. A Maneuver-aware Temporal Fusion framework is proposed to separate short-term dynamics from long-term intentions and fuse them through a motion-complexity-guided attention mechanism. The framework first extracts temporal features at different scales, and then adaptively balances them according to the maneuver patterns of each agent. To support incomplete or short observations, a self-distillation strategy is introduced to reconstruct missing motion segments, enabling consistent prediction without relying on explicit teacher-student models. Furthermore, a Mamba-Transformer hybrid backbone is employed to enhance computational efficiency and improve generalization under arbitrary observation lengths. Experiments on the ETH/UCY and SDD datasets show that MaTF consistently outperforms existing methods, particularly in scenarios with irregular or shortened observations.

Shuobo Wang, Wenyuan Qin, Yongzhao Hua et al. · 0 citations
Preprint Jul 2026

A Reliable Context-Aware and Temporal Planning Framework for Autonomous Driving

Safe operation of autonomous vehicles in dense urban traffic depends on perception and planning that remain reliable when onboard sensing is degraded. In real driving conditions, camera observations are frequently corrupted by occlusion, motion blur, illumination change, and sensor noise, and when such degraded observations are aggregated indiscriminately over time, trajectory planning becomes unstable and collision risk rises for both the ego vehicle and surrounding road users. Recent Bird's-Eye-View (BEV) approaches unify perception and planning through a shared spatial representation, but most fuse temporal information across frames without assessing the reliability of the underlying observations. We present a Reliable Context-Aware and Temporal Planning framework for Autonomous Driving (RCT-AD) that explicitly models feature quality and temporal consistency to support safer, more consistent planning. A Reliable Context Awareness module scores per-frame reliability and selectively retains trustworthy features through a quality-gated First-In-Last-Out (FILO) memory mechanism, reconstructing degraded observations from reliable historical context so that corrupted inputs do not destabilize the scene representation. A Temporal Trajectory Planner captures long-term dependencies and multi-agent interactions to produce smoother, safety-aware trajectories, while a joint detection-and-segmentation head injects semantic and motion cues into the shared BEV space to strengthen scene understanding. Experiments on the nuScenes autonomous driving benchmark show that RCT-AD improves perception accuracy, motion prediction, and planning robustness over recent end-to-end baselines, achieving 61.5 nuScenes Detection Score, 52.9 mean Average Precision, and 52.3 mean Intersection over Union, while maintaining competitive computational efficiency suitable for real-time deployment.

Argho Dey, Yunfei Yin, Swachha Ray et al. · 0 citations