Skip to content

Perturbation Sensitivity of Maximum-Likelihood Pairwise Ranking in Computational Decision Systems

Apr 2026 · 3 citations · 11 references
Computer Science

TL;DR

This work describes coordinated perturbation as a budgeted subset-selection problem over pairwise observations and introduces an Adaptive Subset Selection Attack (ASSA) as a scalable search heuristic for probing high-impact perturbation sets.

Abstract

Maximum-likelihood pairwise ranking is a com- mon computational mechanism for prioritization, reputation estimation, and comparison-driven decision support. Despite its broad use, the perturbation sensitivity of this estimator under structured changes in comparison data remains insufficiently characterized. We study this question as an applied-mathematics and computational-science problem in stability analysis. We for- mulate coordinated perturbation as a budgeted subset-selection problem over pairwise observations and introduce an Adaptive Subset Selection Attack (ASSA) as a scalable search heuristic for probing high-impact perturbation sets. Through experiments on synthetic and observed preference datasets, we show that MLE-based ranking can exhibit pronounced regime-dependent sensitivity: relatively small but coordinated perturbations may in- duce meaningful changes in output orderings, while the response profile varies across budgets and data conditions. By comparing ASSA with random, greedy, and randomized subset baselines under repeated trials, we characterize both the magnitude and the variability of perturbation-induced ranking shifts. These results position pairwise ranking sensitivity as a problem in computational reliability, numerical stability, and robustness auditing for engineering systems built on comparison-driven inference.

View source

Similar papers

#machine learning Preprint Aug 2026

Adaptive Doubly Robust Off-Policy Evaluation for Ranking Policies under Diverse User Behavior

Adaptive Doubly Robust (ADR) is proposed, which combines adaptive importance weighting with re- ward regression through a control-variate correction and establishes its unbiasedness when the true user behavior model is observed and characterize a sufficient condition under which it reduces vari- ance relative to AIPS.

Kosuke Iguchi, Ren Kishimoto · 0 citations
Preprint Aug 2026

Adaptive KappaSharp: Condition-Number Shaping for Preferential Bayesian Optimization

KappaSharp is proposed, a diagonal correction to the Hessian to reduce its condition number, with larger corrections where the prior uncertainty is higher, that enables a diagonal correction to the Hessian to reduce its condition number.

Ketong Shao, Jia-Lu Wang, X. Pei et al. · 0 citations
Open access Sep 2026

Assortment Optimization in the Presence of Context Effects

Problem definition. We study choice modeling and assortment optimization under context effects, where an item’s perceived attractiveness depends on the other items displayed alongside it. Methodology. We study the Contextual Multinomial Logit (CMNL) model, in which each item’s utility adjusts linearly with the presence...

Reza Yousefi Maragheh, Shuai Li, Tian-Cheng Zhao et al. · 0 citations
Aug 2026

A Distribution-Free Sequential Selection Strategy: Data-Driven Optimal Allocation via Balancing Empirical Large Deviations

The ranking and selection problem is a classic mathematical framework about identifying the best alternative from multiple alternatives through sampling them. However, the uncertainty about sampling distributions in the ranking and selection problem has been relatively overlooked, and related research is just starting...

Yen-Chia Chen · 0 citations
Open access Aug 2026

Robust Monotone Ratings: A Bayesian, Linear-Time Scheme for Massive Ranked Competitions

This paper introduces a computer science approach to large-scale skill estimation that unifies probabilistic modeling with algorithmic efficiency. We present a Bayesian rating framework that models skills, performances, and ranked evidence, deriving closed-form MAP updates and a pseudodiffusion mechanism for temporal s...

Mafaz Mohammed Nadherssa · 0 citations
#artificial intelligence Preprint Sep 2026

Risk-Aware Adaptive Evaluation: Finding High-Impact Failures Under Limited Budgets

Evaluating interactive agents is expensive. Agent behavior is stochastic, so reliability must be measured over repeated trials, but failures are rare and differ widely in how much they matter. Standard benchmarks spend this budget uniformly: a read-only lookup is sampled as often as an irreversible payment action. We i...

Priyanath Maji, S. Chowdhury · 0 citations

Related blog posts

MIT News · Artificial Intelligence Sep 29, 2026

Who we become when we talk to machines

Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.