Skip to content
Preprint

A directional Hosmer-Lemeshow goodness-of-fit test for sparse logistic regression

Jul 2026 · 1 citation · 25 references
Mathematics

Abstract

Goodness-of-fit assessment for the binary logistic regression model is difficult when covariates are continuous: the data are effectively sparse, the classical Pearson and deviance tests fail, and practitioners rely on partition-based tests, such as the Hosmer-Lemeshow test, that group observations before comparing observed and expected counts. We study a partition test that modifies the Hosmer-Lemeshow statistic with a single directional correction term, weighted by $(1-2\bar\pi_g)$ and referred to a $\chi^2_{G-2}$ distribution. The correction is the grouped form of the Osius-Rojek/Farrington standardization; grouping makes it well defined in the sparse regime, and it targets the asymmetric over- and under-prediction that a misspecified link induces. A single alignment functional captures its effect, predicting where the test gains power (asymmetric-link misspecification) and where it does not (symmetric departures, and covariate-space structure that no probability-grouping test can see). In simulations the test holds its size; no well-calibrated partition test is more sensitive to asymmetric-link misfit, and it clearly exceeds Hosmer-Lemeshow there, most so for the complementary log-log link -- a modest gain that fades as $n$ grows; it ties Hosmer-Lemeshow on an omitted interaction and is less powerful on an omitted quadratic (by about ten percentage points at $n=1000$). A real-data application illustrates its use, and the test is implemented in the R package ebrahim.gof.

View source

Similar papers

Preprint Sep 2026

Shrinkage invalidates the Hosmer-Lemeshow test: goodness of fit for penalized logistic regression, with an application to glaucoma diagnosis

The corrected law is derived and the shrinkage-corrected Hosmer-Lemeshow test is defined, which subtracts an estimate of that non-centrality induced by shrinkage, restoring the maximum likelihood reference exactly to first order, and is made valid by prepivoting at a power cost the authors measure.

Ebrahim Khaled Ebrahim · 0 citations
Preprint Aug 2026

Goodness-of-Fit Tests and Calibration Machine-Learning Algorithms for Logistic Regression with Sparse Data

This thesis studies classical GOF tests for binary logistic regression under both grouped and sparse data, comparing about 30 statistical tests and machine-learning calibration algorithms and concludes that model assessment requires a combination of several powerful statistical tests alongside careful visual inspection...

Ebrahim Khaled Ebrahim · 1 citation
Preprint Jul 2026

Benchmarking Goodness-of-Fit and Calibration Algorithms for Logistic Regression Classifiers: A Large-Scale Simulation Study under Sparse Data

This paper provides a unified taxonomy and a large-scale, reproducible simulation benchmark; more than twenty tests are implemented in the open-source R package ebrahim.gof, and translate these findings into practical, evidence-based guidance for assessing logistic regression fit.

Ebrahim Khaled Ebrahim, Ahmed El-Kotory · 0 citations
Preprint Aug 2026

Distribution-free testing of linear type

We introduce a distribution-free goodness-of-fit test, termed the omega-1 test, which naturally complements the Kolmogorov--Smirnov test and Cram\'{e}r--von Mises test and can be viewed as their (piecewise) linear analog. Defined as an $\mathrm{L}^{1}$-functional of the empirical process, the test statistic improves on...

Wei-Xu Xia · 0 citations
Preprint Jul 2026

Testing for correct model specification in copula regression models

We propose a goodness-of-fit test for semiparametric copula regression models. Such models express the regression function in terms of marginal distribution functions and copula densities and therefore provide a flexible way to avoid fully nonparametric estimation in high-dimensional regression problems. Their performa...

Holger Dette, Philipp Dörr · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.