Skip to content

HyBDM: Multi-Scale Hybrid Experts for Time Series Forecasting with Bidirectional Dependency Modeling

Jul 2026 · arXiv.org · Vol abs/2607.16882 · 0 citations · 30 references
Computer Science

TL;DR

Experiments show that HyBDM outperforms state-of-the-art methods in both forecasting accuracy and computational efficiency, demonstrating its effectiveness in bridging global-local dependencies for multivariate TSF.

Abstract

Time series forecasting (TSF) is vital to many applications, yet existing models often struggle to capture the heterogeneous long-range global patterns and short-range local variations in multivariate time series. While some approaches partially model these dependencies, they often do not jointly exploit temporal and feature-wise information. To address this challenge, we propose HyBDM, a multi-scale hybrid model that decomposes temporal dynamics into global patterns and local variations, which are modeled by two specialized experts. The Global Patterns Expert employs an enhanced BiConv-Mamba module that integrates bidirectional convolutions, an M-SSM layer, a forgetting mechanism, and a GDD-MLP module for cross-channel modeling. The Local Variations Expert uses a Local Window Transformer (LWT) to perform efficient locality-aware attention with reduced computational complexity. In addition, a Multi-Scale Patcher and a Long-Short Router enable multi-resolution representations and adaptive fusion of the two experts. Experiments on six benchmark datasets show that HyBDM outperforms state-of-the-art methods in both forecasting accuracy and computational efficiency, demonstrating its effectiveness in bridging global-local dependencies for multivariate TSF.

View source

Similar papers

Conference 2026

DeRNN: Decomposed Recurrent Neural Network for Long-Term Time Series Forecasting

The Decomposed Recurrent Neural Network (DeRNN) is proposed, which decouples global trend modeling from local fluctuation extraction via an asymmetric dual-track architecture and exhibits superior robustness against noise and distribution shifts.

Shanyun Qian · 0 citations
Open access Sep 2026

FCA-Transformer: A Feature Pyramid Time Series Forecasting Model Driven by Cross-Attention Mechanism

The findings indicate that the proposed architecture successfully reconciles multi-scale feature extraction with lightweight dependency modeling, enhancing structural generalization and providing a scalable framework for real-time temporal analysis in complex industrial environments.

Lin-Li Wu, Ji-Yong Zhang, Zhi-Ming Zhang et al. · 0 citations
Open access Aug 2026

Multivariate time series forecasting with multi-view hierarchical patching and lag-coupled channel attention

HMV-Former, a forecasting architecture that integrates multi-view hierarchical patching with lag-coupled channel attention, is proposed, which highlights its advantages in multi-scale feature abstraction and dynamic dependency governance, and suggests its potential to support intelligent decision-making in complex syst...

Xinbang Fang, Tao Ma, Ke Lu et al. · 0 citations
#machine learning Preprint Sep 2026

SETTer: Sparse-Encoder Transformer for Long-term Multivariate Time Series Forecasting

SETTer is introduced, a transformer-based model that addresses challenges of long-term multivariate time series forecasting by incorporating novel techniques for decoupled self-attention and hybrid masking and outperforms state-of-the-art models in 88% of the scenarios.

Abraham Ezema, C. Eze, F. Ponci et al. · 0 citations
Open access Aug 2026

TimeHome: Heterogeneous Mixture-of-Experts for Time-Series Foundation Model

TimeHome is a universal sparse transformer basic model for handling heterogeneous time series that incorporates a Heterogeneous Mixture-of-Experts (H-MoE) component, where different expert types are chosen dynamically based on a low-rank temperature-controlled gating mechanism to fit various sequence features.

Tao Zhang, Xiaobo Wu, Xing-Guo Li et al. · 0 citations
Conference Jul 2026

NeuroFlexMLP: A Low Complexity MLP Architecture for Long-Term Time Series Forecasting

Forecasting time series over long horizons is essential for proactive decision-making in many systems. Recent research has focused on transformer-based architectures, which capture long-range dependencies in sequential data. However, several studies show that simpler linear models can outperform transformers by avoidin...

P. F. Pérez, Claudio Fiandrino, Marco Fiore et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.