LLR2, a novel fully unsupervised concept drift detector based on Bayesian networks, is proposed, which computes a log-likelihood ratio that is evaluated against chi-squared quantiles for each variable.
Machine learning (ML) models are increasingly deployed in real-world environments where data characteristics, user behaviour, and operating conditions may change over time. Such changes can lead to data or concept drift and may gradually reduce model reliability. Existing monitoring approaches can identify distribution...
Tambe Ankit Sampat· International Journal of Cre...· 0 citations
Commonly, classifiers and monitoring procedures are trained from labeled data by optimizing an objective such as the misclassification rate. This may lead to unrepresentative conditional distributions of the outcome (the labels) given important external variables, different from the conditional laws in the population....
RiskBlend is proposed, a classifier-agnostic prioritization framework that combines four complementary risk signals: historical failure patterns, prediction shift, decision-boundary shift, and neighborhood change that achieves the highest average APFD in all 80 dataset-classifier-scenario combinations.
A structured multi-metric evaluation framework that integrates classification, ranking-based, calibration, and robustness-oriented metrics for comprehensive ML performance assessment is proposed capable of supporting more reliable real-world ML deployment.
Ade Putra, E. Noche, Diksha D. Gabhane· Journal of Data Science· 0 citations
These results support a scoped monitoring strategy for similar tabular settings: confidence-derived scores are effective for pointwise screening, whereas group-aware explanation audits provide complementary evidence about stable but incorrect feature reliance.
An uncertainty-aware machine learning framework that integrates probabilistic modeling techniques into conventional predictive architectures to jointly estimate epistemic and aleatoric uncertainty is proposed, indicating that incorporating uncertainty estimation enhances trustworthiness and robustness without sacrifici...
Evi Yulianingsih, E. Noche, V. Yadav et al.· Journal of Data Science· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.