Stochastic Latent World Modeling (LWM), a trajectory-based representation-learning framework that enriches classification through stochastic latent-state prediction, enables the classifier to exploit structured dependencies in the representation space and provides richer features for HSIC.
Abstract
Hyperspectral image classification (HSIC) relies on static spatial-spectral representations learned from labeled samples, limiting its ability to model structured dependencies in the latent representation space. To address this limitation, this work proposes Stochastic Latent World Modeling (LWM), a trajectory-based representation-learning framework that enriches classification through stochastic latent-state prediction. Given a hyperspectral patch, LWM tokenizes and encodes spectral and spatial information separately using dedicated transformer branches, then fuses their outputs into a unified representation. This representation is further organized into an environment state that captures center, neighborhood, spectral, and global contextual information. A stochastic latent transition module then predicts multiple future latent states through Gaussian parameterization and reparameterization, with recurrent refinement used to model dependencies across successive states. The resulting latent trajectory is adaptively aggregated by a rollout planner to construct a planned representation, which is integrated with the base representation for final classification. By extending static spatial-spectral encoding with stochastic multi-step latent-state modeling, LWM enables the classifier to exploit structured dependencies in the representation space and provides richer features for HSIC. Across five benchmark datasets, LWM achieves overall accuracies ranging from 89.21% to 99.52%, demonstrating consistent classification performance under limited-label settings.
Few-shot hyperspectral image classification (FS-HSIC) remains highly challenging because the limited number of labeled samples not only makes traditional supervised learning models prone to overfitting but also restricts their ability to learn generalizable spatial–spectral representations. Moreover, existing methods a...
A novel knowledge transfer paradigm from classification tasks to anomaly detection is proposed, which employs a pretrained convolutional enhanced Transformer (CET) classification network as the teacher model, transferring its rich spectral–spatial context encodings via feature-level distillation.
Lei Xia, Yin-Nian Liu· Remote Sensing· 0 citations
This work proposes a four–stage hybrid framework for hyperspectral image classification that integrates spectral modeling and spatial feature extraction within a unified pipeline and compares the model with recent baselines, including DaViT.
A hyperspectral conditional diffusion for dense (HCD2) classification framework is proposed in this article, which reformulates HSI classification as a conditional label-map denoising process guided by hyperspectral features, enabling generative dense semantic inference.
Hong-Qiao Wang, Hai-Yan Sun, Xuan-Chen Yan et al.· IEEE Transactions on Geoscie...· 0 citations
RS-HCFormer is proposed, a hierarchical conditional encoding Transformer for hyperspectral image classification that substantially outperforms state-of-the-art methods in both accuracy and efficiency.
Qiang Li, Hao-Yue Xu, Jia-Ning Zhang et al.· 3rd International Conference...· 0 citations