Stochastic Linear Bandits with Partially Observed Actions
This work proposes an algorithm, TOFU-POV, that estimates the latent action subspace using the masked actions, imputes current actions using an epoch-wise frozen representation, and runs OFUL in the resulting low-dimensional coordinates, and devise a rank-adaptive algorithm that does not require the knowledge of the in...