Skip to content
Book Open access

Accurate and Low-Cost Residual Risk Assessment via Sampled Profiling and Structure-Aware Coverage Amplification

Oct 2026 · Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering · 0 citations · 33 references

TL;DR

This work proposes a risk assessment method in the context of black-box fuzzing that leverages hardware-enabled performance profiling—replacing coverage instrumentation with instruction pointer (IP) sampling—as the core mechanism for low-overhead observation, enabling fuzzing campaigns to reach stopping thresholds 2× faster while maintaining high accuracy.

Abstract

Estimating the residual risk of undiscovered bugs—and thus when to stop fuzzing—is critical for determining testing adequacy. Traditionally, this assessment relies on coverage instrumentation, which records complete coverage of every execution but imposes a 60-70% performance slowdown, reducing fuzzing throughput and delaying bug discovery. This overhead raises a fundamental question: can partial observation provide high-fidelity confidence at a fraction of the coverage instrumentation cost? We propose a risk assessment method in the context of black-box fuzzing that leverages hardware-enabled performance profiling—replacing coverage instrumentation with instruction pointer (IP) sampling—as the core mechanism for low-overhead observation. To recover the accuracy inevitably lost to the sparse nature of sampling, we employ must-execute analysis, a static control-flow analysis that identifies all statements and basic blocks that must have executed to reach, or must execute after, an observed sample, effectively reconstructing missing execution paths from partial observations. Despite the partial coverage inherent to profiler-based sampling, our risk estimation method achieves 4.27× higher throughput than complete-coverage instrumentation, enabling fuzzing campaigns to reach stopping thresholds 2× faster while maintaining high accuracy (1.73 average relative error compared to the ground truth). Ultimately, this efficiency translates into superior bug discovery, triggering more bugs with speedups of up to 10× within the same time budget.

Read PDF

Similar papers

Preprint Sep 2026

Robustness-Aware Evaluation and Enhancement of Mutation-Based Fuzzing for Bug Discovery

Splitting, a black-box wrapper that copies a fuzzer's queue state after a bug trigger and continues from that state in multiple branches, directing more effort toward the discovered region, provides a practical way to measure and improve fuzzers.

Zi-Rui Liu, Meng-Fan Xu, Juan Zhai et al. · 0 citations
#artificial intelligence Preprint Sep 2026

SWE-Test: Benchmarking LLM Vulnerability Discovery via Input Prediction

This work recasts vulnerability discovery as an input-prediction task with a closed, deterministic ground truth, and decomposes discovery into three task modes over 22 real-world C/C++ programs spanning 15 domains, finding constraint inference, not navigation, is the dominant bottleneck.

Yuan-Xiang Shi, Jia-Yi Lin, Xuan-Yong Lin et al. · 0 citations
Book Open access Oct 2026

Stop When It Matters: Detectability-Guided Microbenchmarking for Performance Regression Testing

Findings reveal that detectability-guided execution offers a theoretically grounded yet practical path toward efficient microbenchmark-based regression detection, achieving substantial speedups with formal statistical guarantees.

Zong-Xiong Chen, De-Rui Zhu, Jin-Fu Chen et al. · 0 citations
Open access Aug 2026

SNIPTEST: Fuzzing Multi-Level Code Slices for Validating Vulnerabilities

SNIPTEST is an execution-based warning triage framework that generates and fuzzes compiled code slices centered around static-analysis warnings that employs a layer-by-layer slicing strategy, incrementally expanding context around the target location to validate potential vulnerabilities with increasing precision.

Aniruddhan Murali, Noble Saji Mathews, Mahmoud Alfadel et al. · 0 citations
Preprint Oct 2026

On the Reliability of LLM-Based Vulnerability Patching Benchmarks

These results show that benchmark scores are highly sensitive to evaluation design, and practical guidelines for more rigorous, reliable, and reproducible evaluation are provided.

Dang K. Le, Wen-Xuan Shi, Xin-Yu Xing · 0 citations
Book Open access Oct 2026

BanditFuzz: A Synergistic Differential Fuzzing Framework for Compilers

Compiler fuzzing is critical for ensuring the reliability of modern optimizing compilers. However, traditional generators and raw Large Language Model (LLM) outputs often yield syntactically invalid or low-value programs, incurring significant computational overhead. In this paper, we present BanditFuzz, an end-to-end...

Dong-Hui Li, Ying-Ying Li, Jin-Long Xu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.