Sep 2026· Journal of Computing and Electronic Information Management· 0 citations· 34 references
TL;DR
This work starts from the underlying feature representation mechanism to deeply deconstruct data representation strategies which include dimensionality reduction decomposition, time-frequency domain conversion and masked pre-training, to provide a panoramic reference for the theoretical breakthroughs and engineering deployment of complex time series analysis.
Abstract
Multivariate time series data constitutes the fundamental basis for decision making across real-world scenarios such as financial trading, intensive care, energy dispatch and the Internet of Things. Traditional statistical methods and early deep learning architectures including recurrent neural networks and convolutional neural networks expose structural bottlenecks when these models capture long-range dynamic dependencies, process high-dimensional cross correlations and accommodate data expansion on a massive scale. The Transformer architecture relies on the self-attention mechanism to break the traditional paradigm of sequence modeling through parallel computing capabilities and flexible global receptive fields. This architecture has emerged as the cutting-edge foundation for the analysis of multivariate time series. However, the standard Transformer model remains restricted by quadratic computational complexity, data starvation effects and the lack of interpretability associated with black box characteristics when this model processes real-world data featuring high-frequency fluctuations, non-stationarity and significant noise interference. This paper systematically synthesizes the key theoretical and methodological breakthroughs in the field of time series forecasting in recent years. This work starts from the underlying feature representation mechanism to deeply deconstruct data representation strategies which include dimensionality reduction decomposition, time-frequency domain conversion and masked pre-training. By integrating specific application scenarios, this paper conducts a fine-grained dynamic classification and performance evaluation of current deep learning models. This evaluation specifically focuses on efficient sparse attention, sequence decomposition, patch-based designs and multimodal hybrid Transformer architectures. Building upon this foundation, this work examines the severe challenges facing the field and prospectively explores future academic trajectories which encompass time series foundation models, physics-informed design, counterfactual reasoning and federated learning. The ultimate goal of this paper is to provide a panoramic reference for the theoretical breakthroughs and engineering deployment of complex time series analysis.
Large-scale time-series forecasting underpins decision-making in energy systems, traffic operations, industrial monitoring and financial analytics. Recent recurrent, convolutional and Transformer-based models have improved predictive accuracy, yet three limitations remain: inefficient modelling of long input windows, i...
A novel architecture that combines a graph neural network block with a Long Short-Term Memoryencoder-decoder block for end-to-end feature learning and forecasting in multivariate time series forecasting is proposed, resulting in accurate and reliable predictions.
Ali Sarabi, Arash Sarabi, G. Runger· IISE Annual Conference &...· 0 citations
This paper proposes a novel architecture to improve forecasting performance over long horizons: the Multi-Scale Transformer, which effectively captures both short-term fluctuations and long-term trends by extending the transformer by integrating multi-scale processing.
YongKyung Oh, Alex A. T. Bui· IISE Annual Conference &...· 0 citations
SETTer is introduced, a transformer-based model that addresses challenges of long-term multivariate time series forecasting by incorporating novel techniques for decoupled self-attention and hybrid masking and outperforms state-of-the-art models in 88% of the scenarios.
Abraham Ezema, C. Eze, F. Ponci et al.· arXiv.org· 0 citations
We introduce OFTER (online forecasting via temporal embedding regression), a time series forecasting pipeline tailored for financial problems centered on mid-sized multivariate time series. OFTER utilizes the non-parametric models of k-nearest neighbors and generalized regression neural networks, integrated with a dime...
N. Michael, Mihai Cucuringu, Sam Howison· International Journal of Dat...· 0 citations
Benefiting from the linear-complexity Mamba architecture and hierarchical latent representation fusion, UMambaNet provides an effective balance between forecasting performance and computational efficiency.
Xiao-He Wu, Kun Zhang, Hui Chen et al.· Journal of Supercomputing· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.