When providing forecasted probabilities with a predictive model, the ideal model offers perfect calibration: the true probability of the outcome (i.e., the probability that $Y=1$) exactly matches the forecasted probability $f(X)$. In practice, models inevitably exhibit calibration error, and it is therefore important t...
A general framework is developed to quantify the extent to which any ensembling strategy defined via averaging can yield stability guarantees for any type of data perturbation, and provides much sharper guarantees than those obtained from privacy considerations.
In this work, we study the problem of testing conditional independence between random variables $X$ and $Y$ given a confounder $Z$. The local permutation test (LPT) offers a principled approach to this problem by partitioning the $Z$-space into pre-specified bins, and permuting the $X$ and $Y$ data within each bin, to...
David Chen, Rohan Hore, Rina Foygel Barber· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.