Hierarchical Multilevel Monte Carlo for Order-Optimal Neural Actor-Critic in Average-Reward CMDPs
A hierarchical Multilevel Monte Carlo neural critic that performs debiasing simultaneously across trajectory sampling and critic optimization and establishes the first order-optimal convergence guarantees for infinite-horizon average-reward CMDPs with general policy parameterization and neural critics, while eliminatin...