PAC-LLM is proposed, a phase-space-aware adaptive fusion framework for long-term chaotic time series forecasting powered by LLMs that leverages learned phase-space features and textual information to fully enable LLM's time series forecasting capacity.
Abstract
Chaotic time series forecasting is a challenging task due to its sensitivity to initial conditions and long-term unpredictability. Traditional methods typically rely on sufficient temporal trajectories to learn long-term dynamics, which limits their applicability when only short-term observations are available. While recent Large Language Models (LLMs) have shown great potential for time series forecasting, their temporal representations are not explicitly tailored to the phase-space structure and nonlinear evolution of chaotic systems. To address these issues, we propose PAC-LLM, a phase-space-aware adaptive fusion framework for long-term chaotic time series forecasting powered by LLMs. PAC-LLM leverages learned phase-space features and textual information to fully enable LLM's time series forecasting capacity. In particular, we design an auxiliary feature module and a gated weighting mechanism for multivariate coupling information fusion and selection. Extensive experiments on representative chaotic systems demonstrate that our method outperforms existing fine-tuned and zero-shot baselines in both short-term and long-term predictions. Our ablation study further confirms the effectiveness of each key component in PAC-LLM.
SCALER is a coarse-to-fine forecasting framework that first employs a lightweight Transformer tailored to long-term shape modeling to predict a coarse representation of future dynamics, and reduces reliance on long description prompts, and its fixed-step refinement avoids costly reward-model-based selection, further lo...
Xuan-May Le, Minh-Tuan Tran, Ling Luo et al.· Proceedings of the 32nd ACM...· 0 citations
Deep learning surrogates have become powerful tools for simulating and forecasting complex dynamical systems, yet their utility remains limited by catastrophic error accumulation during long-term autoregressive rollouts. This behavior is partly tied to the nature of the underlying systems: chaotic spatiotemporal system...
TS-MTM is proposed, a Temporal-Spectral Masked Time-series Modeling framework that formalizes pretraining within a joint representation space and introduces two synergistic mechanisms: Axial-Period Cross Masking to capture temporal dependencies across phases, and Structure-aware Spectral Magnitude Masking to reconstruc...
Pengcheng Zhang, Xiao-Cao Ouyang, Xin Li et al.· Proceedings of the 32nd ACM...· 0 citations
A novel pattern-guided mixture-of-experts that expands model capacity through sparse activation and uses shallow patch similarities to constrain deep-layer routing, guiding expert specialization across heterogeneous time series and an implicit quantile network head that predicts arbitrary quantiles to characterize pred...
Xingjian Wu, Chen-Juan Guo, Xiangfei Qiu et al.· 0 citations
SETTer is introduced, a transformer-based model that addresses challenges of long-term multivariate time series forecasting by incorporating novel techniques for decoupled self-attention and hybrid masking and outperforms state-of-the-art models in 88% of the scenarios.
Abraham Ezema, C. Eze, F. Ponci et al.· 0 citations
In order to make well-informed decisions, long-term time series forecasting is crucial for a number of applications in finance, energy, and environmental science. While traditional transformer models have demonstrated a strong ability to capture temporal dependencies, they frequently struggle to handle the lengthy sequ...
YongKyung Oh, Alex A. T. Bui· IISE Annual Conference &...· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 14, 2026
Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.