Li-Su Wang

Sharp Characterization of Bias in Post-Bandit Inference

This work identifies the algorithmic origin of bias through a key index-function-dependent quantity, which is term effective exploration rate, and shows how bias most severely distorts confidence intervals and hypothesis tests when the tested arm is one of the tied-optimal arms.