Skip to content
Preprint

On E-Backtesting: Generalizations and Sample Size Determination

Sep 2026 · 0 citations
Mathematics

Abstract

We present an approach for determining sample sizes required to detect underestimations of the expected shortfall with a prescribed power when applying the recently proposed e-backtesting procedure. We consider scenarios in which the value-at-risk at level $p$ is always estimated correctly, while the difference between the true expected shortfall and the value-at-risk is underestimated by a given factor $r$. We show that exploiting the structure of the backtest e-statistic proposed for backtesting the expected shortfall at level $p$ enables the derivation of approximate lower bounds for the required sample sizes by considering a sequence of independent and identically distributed Bernoulli random variables. We also discuss potential limitations of this approximation and compare the resulting sample size requirements with those obtained in practical applications using Monte Carlo simulations. Furthermore, we present generalizations of the e-backtesting procedure, in particular to risk measures which constitute Bayes pairs.

View source

Similar papers

Preprint Oct 2026

E-Backtesting Expected Shortfall without Value-at-Risk Forecasts under Time-series Models

Expected Shortfall (ES) measures the average size of tail losses. Its sequential backtests typically also require a Value-at-Risk (VaR) forecast. We develop two e-backtesting methods using only observed losses and ES forecasts: one for iid losses only and the other for time series under an AR-GARCH conditional VaR stru...

Ruo-Du Wang, Jing-Cheng Yu · 0 citations
Preprint Oct 2026

Improved E-Value Thresholds with Applications to Multiple and Sequential Testing

E-values provide a flexible framework for statistical inference, but the universal threshold $1/\alpha$ can be conservative when the null distribution has additional structure. We study how structural restrictions limit the worst-case concentration underlying Markov's inequality, using a nondecreasing density model to...

Jia-Yi Shen, Hou-Zhen Liu, Qi-Run Zeng et al. · 0 citations
Preprint Sep 2026

Empirical Bayes for compound adaptive experiments

We investigate Empirical Bayes (EB) methods in the context of compound adaptive experiments, where the arm distribution in each experiment follows a normal distribution with an unknown mean that we seek to estimate. There are two main EB strategies: $g$-modeling, which estimates the prior by maximizing the marginal lik...

Karun Adusumilli, Jia-Ying Gu, J. Tao · 0 citations
Open access Oct 2026

JACKKNIFE EMPIRICAL LIKELIHOOD FOR INFINITE-ORDER U -STATISTICS

Infinite-order U -statistics play a vital role in modern statistics. However, given their degree k n $k_n$ k Subscript n depends on the sample size n , quantifying their variability is quite challenging, as fixed-degree theories cannot be directly adopted. In this article, we propose a ja...

Qing Wang, Yi-Chuan Zhao, Ting Zhang · 0 citations
Open access Aug 2026

Equal Budgets Change the Verdict: Finite-Sample Bias and a Matched-Budget Re-Examination of Diversity-Enhanced flowMC Ensembles

On two real Bayesian posteriors scored against long NUTS references, uniform pooling improved on the sample-count-matched single run under marginal JS, energy distance, and MMD2 in every recorded run, while the aggregation’s deficit is confined to the biased marginal metric.

Ming-Yu Shi, Fan Zhang · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.