Skip to content
Preprint

From Test Performance to Risk-Based Effect Sizes: A Unified Wald-Type Framework to Design Clinical Validation Studies for Binary and Survival Outcomes

Aug 2026 · 0 citations · 35 references
Mathematics

TL;DR

Close-form links from sensitivity, specificity, and disease prevalence to predictive risks, risk contrasts, and Wald-type variance, power, and sample-size formulas for binary and fixed-horizon survival outcomes for binary and fixed-horizon survival outcomes are provided.

Abstract

Clinical validation studies of predictive tests are usually designed to focus on sensitivity ($Se$) and specificity ($Sp$), while statistical power is often calculated on regression-effect scales (e.g., risk ratio, hazard ratio). However, these quantities are statistically connected. Here, we provide closed-form links from sensitivity, specificity, and disease prevalence ($\pi$) to predictive risks, risk contrasts, and Wald-type variance, power, and sample-size formulas for binary and fixed-horizon survival outcomes. Analyses of statistical efficiency via C- and D-optimal principles demonstrate how prevalence and threshold choices affect study efficiency, supporting rapid decisions in preliminary studies and informing the design of subsequent, larger studies. Simulations show good calibration across most realistic scenarios; when events are rare and test effects are simultaneously very large, continuity and minimum-event corrections are needed to stabilize the approximation. We illustrate the framework with a case study describing use of the coronary artery calcium score for predicting incident cardiovascular disease in patients with type 2 diabetes mellitus. The formulas let investigators check power and required enrollment directly from $(Se,Sp,\pi)$, without running a separate simulation for each design candidate.

View source

Similar papers

Open access Aug 2026

THE EFFECT OF DIFFERENT EFFECT SIZE ASSUMPTIONS ON SAMPLE SIZE AND POWER: AN R-BASED APPROACH FOR CLINICAL RESEARCH

Introduction: In clinical research, sample size and power are usually calculated from closed-form analytic formulas based on a single assumed effect size. This study maps where analytic and Monte Carlo simulation power converge and diverge across clinical designs, and compares assurance (expected power) with classical...

Muzaffer Bilgin, Ertuğrul Çolak · 0 citations
Preprint Aug 2026

Randomization inference for treatment effects on survival outcomes

The log-rank test and Kaplan--Meier plot are standard tools for analyzing time-to-event data in randomized clinical trials, yet neither provides a summary of the magnitude of the treatment effect. Practitioners typically fill this gap by reporting a hazard ratio from a Cox proportional-hazards model or an acceleration...

Lucy D'Agostino McGowan, Joseph Rigdon, Xin-Ran Li et al. · 0 citations
Open access Sep 2026

Bayesian Shrinkage Versus Frequentist Variable Selection in Small-Sample Translational Research: A Monte Carlo Simulation Study Grounded in Regenerative Medicine Biomarker Discovery

Introduction. Observational studies in regenerative medicine represent a promising frontier for the discovery of predictive biomarkers of therapeutic response, yet are structurally constrained by small sample sizes. This low-sample-size regime exposes variable selection methods to a high risk of overfitting and false d...

Michele Francesco Di Tolla, Domenico Iervolino, Vittorio Scisciola et al. · 0 citations
Open access Sep 2026

Bayesian two-sample survival probability curves with comparative summary measures and sensitivity analyses.

Two-sample survival probability curves (TSSPCs) provide a concise way to visualize treatment differences in randomized controlled trials (RCTs). In this paper, we propose various area under the curve (AUC) metrics for TSSPCs as numerical measures for treatment effects. First, in the same spirit as the restricted mean s...

Michelle Leeberg, Thomas A. Murray, Xiang-Hua Luo · 0 citations
Open access Aug 2026

Comparison of Methods for Incorporating Related Data When Developing Clinical Prediction Models: A Simulation Study

In which situations the ancillary data affect CPM performance, given potential heterogeneity, this study explores in which situations the ancillary data affect CPM performance, given potential heterogeneity.

Haya Elayan, M. Sperrin, G. Martin et al. · 0 citations
Open access Aug 2026

Recent criteria and simple rules agreed often on required sample size for developed clinical prediction models.

OBJECTIVE Adequate sample size is essential to the development of new prediction models with binary outcomes. We aim to relate recent approaches to traditional rules of thumb ('simple rules') and assess agreement and differences in judging adequacy of sample size for developed prediction models. STUDY DESIGN AND SETT...

E. Steyerberg, Tobias Hackmann, B. van Calster et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.