Skip to content

EP-MAE: A resource-efficient masked autoencoding framework for 3D neural representation learning.

Aug 2026 · Neural Networks · Vol 205 Pt B, pp. 109542 · 0 citations · 49 references
Medicine

TL;DR

Efficient Point Masked Autoencoders (EP-MAE), a new framework designed to significantly reduce the training cost of 3D self-supervised pre-training while maintaining strong representation quality, and provides a scalable and effective foundation for future 3D neural network models is presented.

Abstract

Self-supervised masked modeling has emerged as a powerful paradigm for learning general-purpose 3D representations without manual annotations. However, existing masked point modeling frameworks rely heavily on neighbor-search-based patch construction, dense token reconstruction, and heavyweight teacher networks, all of which introduce substantial computational overhead and hinder their scalability to large 3D datasets. In this work, we present Efficient Point Masked Autoencoders (EP-MAE), a new framework designed to significantly reduce the training cost of 3D self-supervised pre-training while maintaining strong representation quality. EP-MAE introduces three key components: (1) a serialization-based patch generator that transforms irregular point clouds into spatially coherent sequences, eliminating the quadratic complexity of kNN-based grouping; (2) a context-aware token dropout mechanism that selectively removes masked tokens with insufficient contextual support, reducing decoder input length without harming reconstruction quality; and (3) a lightweight momentum teacher that provides stable feature-space reconstruction targets at minimal computational cost. Together, these components yield a highly efficient masked modeling pipeline. Extensive experiments on standard 3D benchmarks demonstrate that EP-MAE achieves up to 4 ×  faster pre-training than state-of-the-art masked point modeling methods, while achieving equal or superior performance on downstream tasks. These results highlight the importance of structural efficiency in self-supervised 3D neural representation learning and show that EP-MAE provides a scalable and effective foundation for future 3D neural network models. Codes are available at https://github.com/linchengxing/epmae.

View source

Similar papers

Open access 2026

Scalable and Seamless: Accelerated Virtual-Tiling for High-Fidelity Hybrid CNN–Transformer Codecs

We propose a high-capacity, end-to-end framework for large-scale image compression that addresses the trade-off between tiling scalability and perceptual quality, a challenge stemming from the patch-based processing required for high-resolution inputs, which often introduces disruptive stitching artifacts. To mitigate this issue, we present a unified framework built on three complementary components: 1) Accelerated Virtual-Tiling, which simulates boundary interactions during training to improve spatial consistency without incurring the memory cost of multi-patch encoding; 2) Seam-Targeted Distance-Masked Self-Attention, a latent bottleneck mechanism that enables information exchange across patch boundaries; and 3) Boundary-Aware Regularization, which enforces consistency at tile interfaces through an explicit loss formulation. By explicitly modeling cross-boundary dependencies, the proposed method effectively suppresses stitching artifacts while maintaining scalability to high-resolution inputs. Extensive experiments on the Kodak, JPEG AI, and CLIC 2025 datasets demonstrate competitive or superior rate-distortion performance, achieving high structural fidelity with MS-SSIM values of approximately 0.998 at high compression ratios. These results indicate that the proposed framework provides an effective solution with substantially reduced boundary discontinuities for advanced neural image compression systems based on hybrid CNN-Transformer architectures.

S. Buthelezi, Jules R. Tapamo · 0 citations
Preprint Jul 2026

AutoEncoder-Compressed Parallel Split Learning for Pre-trained Model Fine-Tuning

AE-PSL is proposed, a communication-efficient PSL framework that compresses intermediate activations and gradients using a lightweight AutoEncoder placed at the split layer and introduces a novel two-stage alignment mechanism, which adapts the AE to the pre-trained model's feature manifold and client-specific feature distributions before DFT.

Bas Meuwissen, Vasileios Tsouvalas, N. Meratnia · 1 citation
Preprint Jul 2026

RADIANCE: Relative Adaptive Denoising with IP-Adapter for Novel Concept Enhancement

Text-to-image (T2I) diffusion models have achieved striking progress but still struggle to synthesize rare concepts involving unusual attribute-object pairings, often resulting in concept omission or semantic drift where a dominant entity overwhelms the generation. Tracing these failures to a lack of compositional balance during the denoising trajectory, we propose RADIANCE, a training-free framework that treats inference as a closed-loop feedback process. RADIANCE augments pretrained backbones with three modular components: (1) a Compositional Similarity Monitor (CSM) that tracks the emergence of objects and attributes in intermediate latents via CLIP-based feedback; (2) a Bidirectional Scale Controller (BSC) that applies a reactive"restoring force"using positive and negative IP-Adapter scales to rebalance biased trajectories; and (3) a Feedback Guidance Scheduler (FGS) that coordinates these updates across timesteps without additional training. We further extend the framework to multi-object prompts via Delayed Adapter Activation (DAA) and Layer-wise Alternating Guidance (LAG) to prevent premature concept fusion. By overlapping monitoring and denoising through pipelined execution, RADIANCE maintains competitive latency while significantly enhancing the per-sample success rate and effective throughput. Experiments on RareBench and T2I-CompBench demonstrate that RADIANCE consistently enhances compositional alignment and perceptual quality over state-of-the-art baselines.

Zi-Xiang Ni, Bo-Lun Huang, Teng-Fang Hsiao et al. · 0 citations
Preprint Jul 2026

VQ-Transplant: Efficient VQ-Module Integration for Pre-trained Visual Tokenizers

Vector Quantization (VQ) underpins modern discrete visual tokenization. However, training quantization modules for state-of-the-art VQ-based models requires significant computational resources which, in practice, all but prevents the development of novel, cutting-edge VQ techniques under resource constraints. To address this limitation, we propose {\bf VQ-Transplant}, a simple framework that enables plug-and-play integration of new VQ modules into frozen, pre-trained tokenizers by replacing their native VQ modules. Crucially, the proposed transplantation process preserves all encoder-decoder parameters, obviating the need for costly end-to-end retraining when modifying the quantization method. To mitigate decoder-quantization mismatch, we introduce a lightweight decoder adaptation strategy (trained for only 5 epochs on ImageNet-1k) to align feature priors with the new quantization space. In our empirical evaluation, we find that VQ-Transplant allows obtaining near state-of-the-art reconstruction fidelity for industry-level models like VAR while reducing the training cost by 95\%. VQ-Transplant democratizes quantization research by enabling resource-efficient integration of novel VQ techniques while matching industry-level reconstruction performance.

Xianghong Fang, Yuan Yuan, Dehan Kong et al. · 1 citation