Sep 2026· ACM Transactions on Information Systems· 0 citations· 83 references
TL;DR
The generative module in VAEinfox incorporates a Mixture-of-Experts (MoE) paradigm, enhancing representation learning and the decoder's ability to process complex data and extract task-relevant information, improving the model's generative performance while also enhancing its universality and efficiency, particularly when handling implicit feedback.
Abstract
Generative models for top- \(N\) recommendation have garnered significant attention, with Variational Autoencoder (VAE) emerging as a promising approach for modeling user preferences. Yet, traditional VAE-based models encounter two major challenges: simplistic priors may cause posterior collapse, resulting in ineffective latent structures; meanwhile, limited decoder capabilities hinder the processing of complex data and the extraction of task-relevant information, potentially affecting generative performance. To address these issues, we propose VAEinfox, short for Information-Bottlenecked Variational Autoencoder via Gating Mechanism, a simple yet effective framework that mitigates posterior collapse in VAE. VAEinfox introduces an Adaptive Compressed Representation (ACR) module based on the Information Bottleneck (IB) principle to efficiently and adaptively compress and select latent variables, mitigating posterior collapse. It leverages the Relaxed Bernoulli distribution for differentiable compressed representations and employs a dynamic compression probability selection mechanism with a trainable soft mask activation function to automatically adjust latent variable sparsity during training. Then, a joint training objective maximizes mutual information using the Jensen-Shannon estimator to minimize latent redundancy. In particular, the generative module in VAEinfox incorporates a Mixture-of-Experts (MoE) paradigm, enhancing representation learning and the decoder's ability to process complex data and extract task-relevant information. These dual enhancements improve the model's generative performance while also enhancing its universality and efficiency, particularly when handling implicit feedback. Extensive experiments on eight real-world datasets demonstrate that the proposed framework achieves better results than existing competitors and tackles the specified challenges in top- \(N\) recommendation tasks.
Latent Semantic Fusion for Sequential Recommendation via Flow-based Conditional Variational Autoencoders (LSF-SR), a novel framework that uses a Conditional Variational Autoencoder with Normalizing Flows to fuse item ID embeddings and LLM-generated semantic signals.
Shih-Hong Chen, J. Ying, Vincent S. Tseng· 0 citations
The Fusion of Layer-wise Exits for Sequential Recommendation (FLEXRec), a discriminative framework that enhances compact LLMs while retaining scalable full-corpus ranking and achieves state-of-the-art accuracy among competing methods while remaining highly efficient.
Xurong Liang, Tong Chen, Q. Nguyen et al.· 0 citations
VIBMask is proposed, a unified IWFS framework by the variational information bottleneck that mitigates co-adaptation by penalizing mutual information between unselected features and the label, and improves expressivity via an ensemble of diverse selectors that capture heterogeneous sparse patterns.
Lu Sun, Jun Sakuma· Proceedings of the Thirty-Fi...· 0 citations
Inspired by the recent success of Byte Latent Transformer, DP-Rec is proposed, a dynamic latent patching architecture for recommendation that scales effectively to long sequences and achieves a superior efficiency–accuracy trade-off over both non-compressed and fixed-size compression baselines.
Dwipam Katariya, T. Caputo, Akshat Shreemali et al.· Proceedings of the 20th ACM...· 0 citations
MSTabVAE, a novel generative framework that extends TabNet, a deep learning architecture for tabular data, into a conditional variational autoencoder (CVAE) framework, and introduces a multi-step latent mapping strategy to capture complex feature relationships in heterogeneous tabular data.
Comparing parameter-efficient fine-tuning recipes under a single, shared learning rate is a common but flawed practice: when the arms being compared have very different trainable-parameter counts, a shared rate can simultaneously depress the larger arms'means and inflate their variance, manufacturing a large, seemingly...
Yu-Feng Wang· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.