Skip to content
Book

PolarFormer: Radial-Angular Latent Modeling for Unconditional Time Series Generation

Aug 2026 · Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 · pp. 3550-3561 · 0 citations · 26 references

Abstract

Time series generation is essential for data augmentation and privacy-preserving analysis across many real-world domains. Recent progress in discrete token modeling~(DTM) has demonstrated strong potential by transforming continuous sequences into discrete representations and performing generation in the latent space. However, existing DTM-based methods, particularly VQ-VAE based methods, suffer from imprecise manifold modeling, severe codebook collapse, and high generative complexity caused by entangled latent attributes and heuristic sequence decomposition. In this work, we propose PolarFormer, a novel framework for time series generation that addresses these limitations through a polar decomposition-based discrete representation. Specifically, we decompose continuous latent embeddings into radial and angular components, and model them using two independent codebooks, enabling a multi-layer spherical-shell latent topology that more faithfully captures the underlying data manifold. To stabilize representation learning, we reinterpret VQ-VAE quantization as a Mixture-of-Experts routing process and introduce a load-balancing loss to effectively mitigate codebook collapse. In the generative stage, we further propose a structurally decoupled generation strategy that models radial and angular token sequences jointly while leveraging their orthogonality to substantially reduce modeling complexity. Extensive experiments on multiple datasets demonstrate that PolarFormer consistently achieves state-of-the-art performance in time series generation, validating its effectiveness in representation fidelity and generative quality. Our source code has been made publicly available at https://github.com/decisionintelligence/PolarFormer

View source

Similar papers

#machine learning Preprint Sep 2026

Time series generation with spectrally aligned latent flow matching

A spectrally-aligned latent-flow time series generator, where the latent space for flow matching is trained to preserve dynamical properties that are relevant for the suitability of synthetic samples, and incorporating fine-tuning losses based on canonical signal representations helps overcome issues.

Camilo Carvajal Reyes, Felipe Tobar · 0 citations
Preprint Sep 2026

SphereVAE: Hyperspherical Latent Autoencoders for Robust Autoregressive Speech Representation Modeling

SphereVAE is proposed, which constrains the VAE latent space to the unit hypersphere and regularizes the latent distribution toward a uniform prior, so that information is encoded mainly by directional variation, providing a bounded geometric target for autoregressive prediction and reducing the risk of norm drift.

Hao-Yu Zhang, Jing-Bin Hu, Han-Ke Xie et al. · 0 citations
Preprint Aug 2026

AURORA-LM: Autoencoding Unified Representation for Continuous-Latent Diffusion Language Modeling

AURORA-LM is introduced, a continuous-latent diffusion language model that separates the construction of a decodable text representation from the modeling of its distribution, and achieves the strongest performance among evaluated continuous and diffusion-based language models on OpenWebText free generation and XSum su...

Jiajun Liang, Yu-Ling Liao, Yu-Kang Cao et al. · 2 citations
#artificial intelligence Preprint Sep 2026

Walking the Score Manifold: Continuous-time Generative Dynamics on Learned Data Manifolds

This work leverage pretrained score-based models as geometric priors and learn a vector field that evolves data along score-induced interpolation paths that supports generation at arbitrary timestamps and temporal super-resolution beyond the discretization of the training data.

Jan Tauberschmidt, Brian B. Moser, Stanislav Frolov et al. · 0 citations
Book Open access Aug 2026

RePatch: Learning Entropy-Guided Patch Structures with Quantized Representations for Time Series Forecasting

RePatch is proposed, a two-stage framework that learns adaptive and reusable temporal representations for time series forecasting and achieves state-of-the-art performance on most benchmarks and consistently generalizes well across diverse transfer scenarios.

Han-Bin Xiao, Xun Zhou, Ruizhi Huang et al. · 0 citations
Preprint Aug 2026

SPAE: Spectrally Guided Autoencoder for Pretrained Visual Latents

SPAE employs a compact bottleneck to distill stable semantic information while suppressing high-frequency components, thereby improving the alignment between DiT-generated latents and encoder latents, and achieves a favorable balance among visual understanding, generation quality, and reconstruction fidelity.

Yi-Bin Huang, Ji-Xiang Hong, Zongzhao Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.