Oct 2026· Mathematical and Computational Applications· Vol 31, pp. 219· 0 citations
TL;DR
The joint-pivotal safe Poisson-binomial upper confidence bound (JP-SPB-UCB) policy combines exact risk evaluation with certified, batched exploration, and linear-program rounding constructs a safe exploration schedule within K episodes of a lower bound valid for adaptive randomized schedules.
Abstract
Overbooking offsets no-shows, but learning attendance from accepted customers can expose service providers to unsafe decisions. We study finite-menu overbooking under selected show-up feedback and an episodewise overload chance constraint. The joint-pivotal safe Poisson-binomial upper confidence bound (JP-SPB-UCB) policy combines exact risk evaluation with certified, batched exploration. Linear-program rounding constructs a safe exploration schedule within K episodes of a lower bound valid for adaptive randomized schedules. With probability at least 1−δ, every deployed profile has true overload probability at most α; realized overloads remain possible. Under joint reward–safety identifiability, pseudo-regret against the exact safe oracle admits O(TlogT) and O(logT) bounds for each fixed finite-menu instance when δ=T−2; the constants depend on that instance. Lower bounds establish inverse-square near-boundary certification costs and linear regret at fragile boundary optima. On the original balanced instance, JP-SPB-UCB achieves lower terminal pseudo-regret than the two global-certificate baselines. An expanded study of 58 configurations, including reference controls, examines stronger comparisons, parameter sensitivity, boundary censoring, computational costs, and assumption violations without extending the theoretical guarantees to misspecified models.
Learning how to replenish inventory and estimating the cost of doing so require different information. We establish information-theoretic lower bounds for offline multistage inventory control with independent bounded demand. For fixed additive error in total expected cost, policy learning requires cubically many scalar...
Han-Zhang Qin, D. Simchi-Levi, Rui-Hao Zhu· 0 citations
We study the cost of certifying a scalar target driven by a product of centered Bernoulli means when an unobserved terminal gate leaves irreducible uncertainty. Each factor can be queried independently at a price. We derive the exact identified interval and determine when a requested accuracy is feasible. At every fixe...
Abdallah Skiredj, Abderrahman Skiredj, A. El Fallah Seghrouchni· 0 citations
Safe reinforcement learning (RL) commonly enforces expected-cost constraints, but such expectation safety may fail to control the probability of rare high-cost trajectories. Chance-constrained MDPs (CCMDPs) impose a stronger probability-level requirement, but are widely viewed as harder because the chance constraint is...
We study satisficing regret minimization in bandits with knapsacks (BwK), where a learner sequentially selects randomized policies, i.e., distributions over arms, to obtain mean rewards above a satisficing threshold as frequently as possible while respecting finite resource budgets. The performance is measured by satis...
We study stochastic online optimization (SOO) under semi-bandit feedback: in each of $T$ rounds, a policy adaptively observes $n$ independent random variables with unknown distributions, learning only from observed values. First-order stochastic dominance (FSD) monotonicity enables general reductions for learning SOO,...
Tsubasa Harada, Yasushi Kawase, Hanna Sumita· 0 citations
Fraud models rank transactions by estimated risk, but review teams must decide how many cases to open under limited capacity. We formulate this downstream decision as a capacity-constrained top-<inline-formula> <tex-math notation="LaTeX">$K$ </tex-math></inline-formula> policy problem and separate model fitting, valida...