Preprint

TOPIQ: Statistical Error Propagation for Quantity-of-Interest Prediction under Lossy Compression

You-Yuan Liu Bo Jiang Taolue Yang Sheng Di Robert Underwood Sian Jin

Aug 2026 · 0 citations · 34 references

Computer Science Mathematics

TL;DR

TOPIQ is presented, a statistical error-propagation framework that predicts QoI-level bias and uncertainty from compact compression metadata (less than 0.1% of original data) and decomposes QoIs into primitive operators with closed-form propagation rules accounting for spatial error correlation and data-error coupling.

Abstract

Lossy compression is essential for managing massive scientific data, but per-element error bounds do not translate into bounds on downstream quantities of interest (QoIs) such as regional averages, neural network predictions, or multi-field derived quantities. We present TOPIQ, a statistical error-propagation framework that predicts QoI-level bias and uncertainty from compact compression metadata (less than 0.1% of original data). TOPIQ decomposes QoIs into primitive operators with closed-form propagation rules accounting for spatial error correlation and data-error coupling; new QoIs are supported by composition at runtime with no per-QoI derivation or retraining. Across 552 evaluations spanning 4 datasets, 3 compressors, 4 QoI families, and 8 error bounds, 93.1% of configurations achieve well-calibrated predictions. Pre-computed metadata enables post-hoc uncertainty quantification for arbitrary query regions at 56x-402x speedup over direct computation. A case study demonstrates integration into an AI-driven analysis pipeline with end-to-end confidence intervals for dynamically composed queries.

arXiv Semantic Scholar

View source

Similar papers

Cortado: Progressive Retrieval of Lossily Compressed Data with Guaranteed Error Bounds

Cortado is compared with state-of-the-art approaches and it is found that it is the only progressive compressor that guarantees the evaluated error bounds on all tested inputs while achieving the highest throughputs, comparable reconstruction quality, and on-par compression ratios.

B. Burtchell, Martin Burtscher · 0 citations

#artificial intelligence Preprint Sep 2026

Accuracy is Not Enough: A Divergence-Based Approach to Evaluate Fidelity Loss in Quantized LLMs

Deployment of Large Language Models (LLMs) on memory-constrained edge devices relies heavily on aggressive post-training quantization. However, evaluating these models is largely based on zero-shot task accuracy, which depends solely on argmax predictions and is insensitive to changes in the underlying predictive distr...

Shahzeb Qamar, L. Sparrenberg, Christian Bauckhage et al. · 1 citation

Preprint Aug 2026

Target-Aware Calibration Data Selection for Preserving Uncertainty in Quantized Language Models

DPQ is introduced, a lightweight pre-quantization recipe family that uses full-precision predictions to construct target-aligned calibration mixtures of high-doubt examples and generic anchors that better preserve broad multiple-choice QA behavior.

Zhen Yang, Sizai Hou, Kai-Wen Zheng et al. · 1 citation

#natural language process... Jul 2026

Studying quantization trade-offs for efficient inference deployment in machine translation

The experiments show that the trade-off between inference efficiency and translation quality depends not only on the quantization format, but also on the choice of text chunking strategy, as well as on the choice of text chunking strategy.

Jim Zhao, Sohir Maskey, Koen Oostermeijer et al. · arXiv.org · 0 citations

Preprint Aug 2026

Beyond Sparse Weights: When Is Attention Compressible?

Results motivate CertKV, a training-free compressor that reserves one tail-summary slot per head and allocates the rest by value dispersion, which is top-two in seven of nine LongBench-v2 settings, remains in the leading compressed tier on 128K RULER, and realizes a ten-fold cache budget in a packed Llama prototype.

Chi-Wun Yang, Xiaoyu Li · 0 citations

#machine learning Preprint Sep 2026

Neural Residual Modeling for Scientific Data Compression under Guaranteed Error Bounds

This work proposes a post-processing pipeline that augments an RVQ-based compressor with a U-Net trained to predict and correct pixel-space residuals between the original volume and its RVQ reconstruction, and is the first pipeline to combine latent-space RVQ, explicit pixel-space residual correction via a deep spatial...

Surya Majumder, Liang-Ji Zhu, Sanjay Ranka et al. · 0 citations