Nonparametric In-Context Learning under Growing Geometric Complexity: Minimax Optimality and Local Geometry-Adaptivity of Transformers
These results identify conditions under which the resulting predictor exploits local geometry and attains the aggregate minimax rate, and derive an in-context generalization bound for near empirical risk minimizers over this class.