Skip to content

Predicting the Unpredictable: LLM-powered Long-term Chaotic Time Series Forecasting under Short-term Observations

Aug 2026 · 0 citations · 46 references
Computer Science

TL;DR

PAC-LLM is proposed, a phase-space-aware adaptive fusion framework for long-term chaotic time series forecasting powered by LLMs that leverages learned phase-space features and textual information to fully enable LLM's time series forecasting capacity.

Abstract

Chaotic time series forecasting is a challenging task due to its sensitivity to initial conditions and long-term unpredictability. Traditional methods typically rely on sufficient temporal trajectories to learn long-term dynamics, which limits their applicability when only short-term observations are available. While recent Large Language Models (LLMs) have shown great potential for time series forecasting, their temporal representations are not explicitly tailored to the phase-space structure and nonlinear evolution of chaotic systems. To address these issues, we propose PAC-LLM, a phase-space-aware adaptive fusion framework for long-term chaotic time series forecasting powered by LLMs. PAC-LLM leverages learned phase-space features and textual information to fully enable LLM's time series forecasting capacity. In particular, we design an auxiliary feature module and a gated weighting mechanism for multivariate coupling information fusion and selection. Extensive experiments on representative chaotic systems demonstrate that our method outperforms existing fine-tuned and zero-shot baselines in both short-term and long-term predictions. Our ablation study further confirms the effectiveness of each key component in PAC-LLM.

View source

Similar papers

Book Open access Aug 2026

Efficient Test-Time Scaling for LLM-based Time Series Forecasting

SCALER is a coarse-to-fine forecasting framework that first employs a lightweight Transformer tailored to long-term shape modeling to predict a coarse representation of future dynamics, and reduces reliance on long description prompts, and its fixed-step refinement avoids costly reward-model-based selection, further lo...

Xuan-May Le, Minh-Tuan Tran, Ling Luo et al. · 0 citations
Preprint Aug 2026

Dynamics-Aware Weighting for Deep Learning Forecasts of Chaotic Systems

Deep learning surrogates have become powerful tools for simulating and forecasting complex dynamical systems, yet their utility remains limited by catastrophic error accumulation during long-term autoregressive rollouts. This behavior is partly tied to the nature of the underlying systems: chaotic spatiotemporal system...

Fang Zhou, Gianmarco Mengaldo · 1 citation
Book Open access Aug 2026

TS-MTM: Temporal-Spectral Masked Time-Series Modeling for Forecasting

TS-MTM is proposed, a Temporal-Spectral Masked Time-series Modeling framework that formalizes pretraining within a joint representation space and introduces two synergistic mechanisms: Axial-Period Cross Masking to capture temporal dependencies across phases, and Structure-aware Spectral Magnitude Masking to reconstruc...

Pengcheng Zhang, Xiao-Cao Ouyang, Xin Li et al. · 0 citations
#machine learning Preprint Sep 2026

Aurora-X: Built for Extreme Time Series Forecasting

A novel pattern-guided mixture-of-experts that expands model capacity through sparse activation and uses shallow patch similarities to constrain deep-layer routing, guiding expert specialization across heterogeneous time series and an implicit quantile network head that predicts arbitrary quantiles to characterize pred...

Xingjian Wu, Chen-Juan Guo, Xiangfei Qiu et al. · 0 citations
#machine learning Preprint Sep 2026

SETTer: Sparse-Encoder Transformer for Long-term Multivariate Time Series Forecasting

SETTer is introduced, a transformer-based model that addresses challenges of long-term multivariate time series forecasting by incorporating novel techniques for decoupled self-attention and hybrid masking and outperforms state-of-the-art models in 88% of the scenarios.

Abraham Ezema, C. Eze, F. Ponci et al. · 0 citations
Conference

Multi-Scale Transformer for Long-Term Time Series Forecasting

In order to make well-informed decisions, long-term time series forecasting is crucial for a number of applications in finance, energy, and environmental science. While traditional transformer models have demonstrated a strong ability to capture temporal dependencies, they frequently struggle to handle the lengthy sequ...

YongKyung Oh, Alex A. T. Bui · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.