Skip to content
Open access

Efficient Tensor Completion Algorithms for Highly Oscillatory Operators

Jul 2026 · Numerical Linear Algebra with Applications · Vol 33 · 0 citations · 70 references

Abstract

We address the problem of recovering highly oscillatory operators, represented as matrices with a fixed set of observed entries. Given that these matrices can be well compressed by butterfly matrix decomposition of levels requiring only degrees of freedom, we propose a novel reformulation of the butterfly structure as a compact tensor network. Specifically, we reshape the input matrix as an order dense tensor, and cast its butterfly decomposition as a tensor network consisting of order dense tensors. This enables efficient utilization of the existing software infrastructure for dense and sparse tensor computations. Next, we propose several tensor completion algorithms based on the tensor reformulation of butterfly format, and compare them against algorithms using the quantized tensor train (QTT) format. These algorithms leverage popular completion methods such as alternating least squares, gradient‐based optimization, and alternating directions fitting. Moreover, we propose a novel strategy that uses low‐rank matrix completion to efficiently generate an initial guess for the proposed algorithms. To demonstrate the efficiency and applicability of our proposed algorithms, we perform three numerical experiments using simulated oscillatory operators in seismic applications. In these experiments, we use observed entries in the input matrix and demonstrate an computational cost of the proposed algorithms, leading to speedups of orders of magnitude and significant accuracy improvements for large matrices compared to state‐of‐the‐art low‐rank matrix and QTT tensor completion algorithms.

Read PDF

Similar papers

Open access Oct 2025

Efficient Tensor Completion Algorithms for Highly Oscillatory Operators

A novel reformulation of the butterfly structure as a compact tensor network is proposed, leading to speedups of orders of magnitude and significant accuracy improvements for large matrices compared to state‐of‐the‐art low‐rank matrix and QTT tensor completion algorithms.

Navjot Singh, Edgar Solomonik, X. Li et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Iterative tensor network transformations for element-wise evaluation of elementary and filtering functions

Tensor networks are powerful formats for compressing large-scale data. However, their application to general data processing has been limited by the difficulty of performing nonlinear operations. Here, we introduce iterative tensor network transformations (ITNTs), a general algorithmic framework for the element-wise evaluation of elementary and nonlinear filtering functions on data encoded as tensor trains (TTs), a class of tensor networks. Our approach operates entirely in the compressed domain, enabling efficient computation on exponentially large datasets while maintaining a controlled computational cost. We demonstrate its power in two key areas: (I) evaluating highly nonlinear elementary and filtering functions on a 3D reactive flow field, enabling high-fidelity reaction rate computation and region filtering, and (II) finding extrema in complex optimization problems, such as solving Max-SAT instances on spaces up to $2^{70}$ configurations. These results establish ITNT as a foundational tool that provides tensor network methods with the capability for general-purpose data science and large-scale optimization.

Xiao Wang, Tomohiro Hashizume, Pia Siegl et al. · 2 citations
Preprint Aug 2026

BaKron: Efficient Quantization with Kronecker-Factored Hessians

BaKron is an efficient solver that combines anti-diagonal parallelism with a recursive divide-and-conquer construction that matches the cubic scaling of GPTQ while exploiting richer curvature information.

Johann Birnick, Rayan Saab · 0 citations
Open access Dec 2024

Randomized Algorithms for Streaming Low‐Rank Approximation in Tree Tensor Network Format

This work presents the tree tensor network Nyström (TTNN), an algorithm that extends recent research on streamable tensor approximation to the more general tree tensor network format, enabling a unified treatment of various existing methods.

Alberto Bucci, Gianfranco Verzella · 3 citations
Preprint Jul 2026

(MPO)$^2$: Multivariate Polynomial Optimization based on Matrix Product Operators

This work introduces Multivariate Polynomial Optimization based on Matrix Product Operators (MPO)$^2$, a framework that combines learned MPO feature embeddings with compact polynomial weight tensors that yields feature order independent polynomial representations that can incorporate structured operators such as projections, convolutions, and masks for weight tensor symmetries.

Niccolo' Ciolli, Anders Vestergaard Norskov, Michael J. Kastoryano et al. · 0 citations