PosEDO is proposed, which augments fitness-based EDO with an observation-conditioned parameter-space signal from parameter-trajectory pairs generated during evolutionary evaluation, using posterior shifts for change detection and posterior samples for population adaptation.
Abstract
Evolutionary dynamic optimization (EDO) commonly assumes that environmental changes can be detected from fitness variations and handled through random re-initialization, historical solutions, or learned transition patterns. Online calibration of black-box simulators introduces a different setting, where the dynamic objective is induced by sequential observations and a changing calibration window, rather than being controlled by explicit variables. Fitness variations therefore cannot be directly attributed to regime changes, while the unknown relationship between successive regimes limits conventional adaptation. We formulate this setting as an observation-driven dynamic optimization problem and propose PosEDO, which augments fitness-based EDO with an observation-conditioned parameter-space signal. PosEDO learns this signal online as a posterior distribution over simulator parameters from parameter-trajectory pairs generated during evolutionary evaluation, using posterior shifts for change detection and posterior samples for population adaptation. The new evaluation records are further utilized for online posterior updating without additional simulator calls. Experiments on nonstationary economic and financial simulators show that PosEDO improves calibration accuracy, optimization performance, and change-detection quality over representative EDO baselines.
Uncertainty-Aware selection is investigated, which forms an ensemble of simulators and selects the online algorithm with the best average performance across the ensemble and leads to more reliable selection and improved online performance.
Yong-Yi Guo, Zi-Fan Xu, Zi-Ping Xu et al.· 0 citations
Traffic digital twins provide realistic system-level testbeds for intelligent transportation system applications. Their value depends on how well they reproduce observed traffic conditions, making calibration against data essential. In practice, traffic digital-twin calibration is a black-box optimization problem in wh...
Abhilasha J. Saroj, Shaked Regev, Guan-Hao Xu et al.· IEEE Access· 0 citations
Dynamic black-box optimization presents significant challenges for Bayesian Optimization (BO), as the objective function evolves over time, causing optimal locations to shift continuously. Existing dynamic BO (DBO) methods using standard acquisition functions such as Upper Confidence Bound (UCB) fail to explicitly acco...
Merlin Angel Kelly, R. Patel, Alexander Thomas et al.· 1 citation
We formulate offline tuning of Model Predictive Path Integral (MPPI) controllers as a chance-constrained black-box optimization problem and develop an update-aware framework based on Matrix Adaptation Evolution Strategy (MA-ES). We use statistical information from noisy controller evaluations to determine when the evol...
M. Kimiaei, Roya Khalili Amirabadi, Mohsen Jalaeian-Farimani· 0 citations
This position paper argues that, in such settings, the objective of offline RL should extend beyond immediate deployment and instead prioritize learning adaptive policy priors: policies that preserve the capacity to improve during subsequent interaction through memory, exploration, and self-correction.
Tian-Wei Ni, Vineet Jain, Akash Karthikeyan et al.· 1 citation
Model-based reinforcement learning (MBRL) can exploit simulated experience, but a simulator-to-target shift creates a model-selection problem: correcting the simulator and fitting the target directly can each fail under limited target data. We introduce the Model-Corrected World Model (MC-WM), which separates initial t...
Yi-Fan Zhang, Liang Zheng· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 14, 2026
Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.