Skip to content

Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction

Sep 2026 · 1 citation · 53 references
Computer Science

TL;DR

This work proposes LoG-VGGT, a memory-efficient framework for long-sequence 3D reconstruction that balances local temporal modeling with global camera consistency, and introduces cross-window attention at a small subset of transformer blocks, enabling effective information propagation across adjacent temporal windows while keeping memory usage bounded.

Abstract

We propose LoG-VGGT, a memory-efficient framework for long-sequence 3D reconstruction that balances local temporal modeling with global camera consistency. Instead of relying on full global attention, our method introduces cross-window attention at a small subset of transformer blocks, enabling effective information propagation across adjacent temporal windows while keeping memory usage bounded. To mitigate long-term pose drift, we further design a global camera consistency refinement module, where camera tokens interact with compact register tokens via cross-attention to enforce scene-level constraints across the entire sequence. This design enables joint optimization of camera representations and significantly improves long-horizon pose stability without incurring the high cost of sequence-wide attention. Extensive experiments demonstrate that LoG-VGGT achieves improved depth accuracy and robust camera pose estimation across multiple long-sequence benchmarks, while delivering competitive streaming reconstruction performance.

View source

Similar papers

Preprint Aug 2026

Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction

ABot-Recon is presented, a simple streaming model that caches KV features from only the preceding 11 frames and predicts a point map in the current camera coordinate system together with an adjacent-frame relative pose that remains equivariant under changes of reference frame.

Jiarong Han, Jincheng Xiong, Yu-Zhou Liu et al. · 2 citations · ⚡1
Preprint Oct 2026

VASC: Value-Aware Sparse Attention with Cross-Layer Memory for Efficient 3D Reconstruction

Feed-forward 3D vision models such as VGGT have achieved remarkable progress, unifying camera estimation and dense scene reconstruction in a single pass. However, their quadratic global attention makes long image sequences expensive, while existing sparse methods may favor highly attended yet value-redundant regions. T...

Jun-Yi Wu, Fan-Qing Kong, Le-Yang Chen et al. · 0 citations
#artificial intelligence Preprint Sep 2026

WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory

WorldCrafter is a video world model that learns a camera-queryable implicit 3D-aware memory that enables streaming scene exploration from a single input image or text prompt and shows substantial gains in long-horizon consistency and camera-control accuracy while preserving visual quality during minute-scale exploratio...

Wang-Bo Yu, Kun-Hao Liu, Wen-Bo Hu et al. · 3 citations
Sep 2026

Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering

Recent 3D foundation models enable generalizable geometric reasoning from RGB images but remain limited in persistent memory, scalability, and renderable scene modeling. We present a memory-centric 3D foundation model for scalable robotic localization, reconstruction, and Gaussian rendering. Its core is an adaptive wor...

Tianchen Deng, Guo-Le Shen, Yi-Lin Shen et al. · 0 citations
Preprint Aug 2026

GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly

GeoWeaver, a unified framework comprising a Geometric Prior Model (GPM) and Test-Time Adaptation (TTA) and a robust CDF-style objective jointly optimizes weighted 2D reprojection and 3D consistency residuals, is presented.

Tinghao Jiang, Sheng Tang, Shengzhe Wei et al. · 0 citations
Preprint Oct 2026

CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction

Feedforward foundation models have recently shown remarkable 3D reconstruction capabilities. However, existing models exhibit large tracking drift in long-context streaming reconstruction due to error accumulation. In this paper, we revisit loop closure with streaming reconstruction foundation models to enable accurate...

Mo-Yang Li, Zihan Zhu, Wei Zhang et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.