Skip to content

Robust Fault Detection in Mechanical Multimodal Time Series via Self-Supervised Cross-Modal Reconstruction

Sep 2026 · 0 citations · 45 references
Computer Science Mathematics

TL;DR

This work proposes a multimodal anomaly detection framework based on cross-modal reconstruction of heterogeneous time-series sensor data that learns system dynamics by reconstructing each modality from the others, thereby exploiting complementary information across modalities.

Abstract

Fault detection is essential in industrial systems, enabling early identification of abnormal behaviour and improving safety, reliability, and operational efficiency. Modern systems increasingly rely on heterogeneous sensing modalities that capture complementary aspects of the underlying physical process. However, existing data-driven anomaly detection methods often process each modality independently or use simple feature-level fusion, limiting their ability to exploit cross-modal relationships that characterize normal system behaviour. Their performance also commonly assumes similar training and deployment distributions, whereas real-world operation is affected by changing operating conditions, environmental influences, and system degradation that induce distribution shifts and reduce detection performance, especially in unseen regimes. In this work, we propose a multimodal anomaly detection framework based on cross-modal reconstruction of heterogeneous time-series sensor data. Rather than modeling each modality independently, the framework learns system dynamics by reconstructing each modality from the others, thereby exploiting complementary information across modalities. This integrates information across sensing channels without requiring explicit temporal alignment or identical sampling rates, while improving robustness to sensor noise, missing measurements, and modality-specific disturbances. To address distribution shifts during real-world deployment, anomalies are identified using cross-modal reconstruction error and an adaptive test-time thresholding mechanism that adjusts to changing operating conditions. Experiments on three industrial case studies show strong fault detection performance and substantially improved robustness under out-of-distribution conditions, with the largest gains observed in the most challenging operating regimes.

View source

Similar papers

Open access Sep 2026

Cross-sensor domain adaptation multi-point monitoring network for mechanical fault diagnosis

UCTL, an end-to-end unsupervised cross-sensor transfer learning network that enables the transfer and reuse of fault features from labeled source monitoring points to unlabeled target monitoring points with disparate data distributions, thereby achieving cross-sensor domain adaptation in multi-point monitoring systems...

Zhi-Jie Zhou, Jiao Lu, Yu Ren et al. · 0 citations
Sep 2026

Wavelet-patch embedding and two-stage attention fusion for multi-sensor mechanical fault diagnosis

An interpretable multi-sensor fault diagnosis framework, termed LCWC-DAMiT, is proposed that introduces a learnable continuous wavelet convolution (LCWC) module to incorporate time–frequency priors into patch embedding and focuses on physically meaningful fault characteristic frequencies and informative sensor location...

Xing-Fa Liu, Wen-Sheng Ma, Chun-Chuan Liu · 0 citations
Open access Sep 2026

Multi-sensor data-driven intelligent product interaction fault self-diagnosis system

A Kronecker Fused Variational-Evolutionary Reconstruction Framework for Adaptive Intelligent Diagnostics (KROVER-AID), which enables real-time, cross-sensor, and across-sensor fault diagnosis and is a scalable and intelligent approach to predictive maintenance and fault management in next-generation smart manufacturing...

Bei-Qin Hu · 0 citations
Open access Sep 2026

An Advanced Multimodal Reliability Assessment for Predicting Remaining Useful Life of Bearings With Degradation Analysis

The proposed multimodal multi‐task learning framework enables simultaneous bearing degradation assessment and remaining useful life prediction by leveraging complementary information from multiple sensing modalities to address the mentioned limitations.

A. N. Sanjrani, Sadiq Ali Shah, N. Q. Soomro et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.