Skip to content
Preprint

Principal component error in high-dimensional factor models

Sep 2026 · 0 citations · 57 references
Mathematics Economics

TL;DR

Researchers who rely on principal component analysis to estimate factor models can use the results to quantify errors in model-based predictions and attributions.

Abstract

In a statistical factor model, principal components (or eigenvectors) of a sample covariance matrix serve as estimates of principal directions, the true drivers of co-movement of a collection of observed variables. We write the often substantial error in these estimates as a sum of two interpretable terms, which we show have almost sure asymptotic limits as the number of variables grows with sample size bounded. This scenario is commonplace in financial economics, genomics, machine learning and signal processing. Out-of-subspace error measures the distance from an estimate to the subspace spanned by population factor exposures. It can be expressed in terms of data, providing an estimable floor for asymptotic error. In-subspace error is driven by a rotation error within that subspace, which arises from the fixed sample size of the latent factor returns and cannot be estimated from data alone. We illustrate our error analysis with a three-factor simulation of the US public equity market, showing the dependence of the magnitude of the error and its components on dimension and sample size. In that simulation, out-of-subspace error dominates. Researchers who rely on principal component analysis to estimate factor models can use our results to quantify errors in model-based predictions and attributions.

View source

Similar papers

Preprint Sep 2026

Factor Model Estimation for High-Dimensional Time Series with Heteroskedastic Noise

Factor modeling provides a framework for extracting common components from high-dimensional time series. We develop an estimator of the factor loading space that combines contemporaneous covariance with lagged autocovariance information. Under cross-sectionally heteroskedastic white noise, the contemporaneous covarianc...

Da-Cang Zhao, Jing Chen · 0 citations
Preprint Oct 2026

Goodness-of-Fit Testing for Groupwise Spherical Error Structures

The analysis of large data panels is important in econometrics and beyond. Prediction and inference methods for such data typically rely on simplifying model assumptions for the covariance structure of errors. One convenient assumption is what we call groupwise sphericity: that errors are uncorrelated across individual...

Daria Tieplova, Nina Dörnemann, Tim Kutta · 0 citations

Journal of Econometrics

Clifford Lam, Ze-Tai Cen · 0 citations
Preprint Sep 2026

Large deviations for linear regressions

Linear regression is one of the simplest and most widely used tools to learn patterns from data: it fits a set of coefficients so that a linear combination of predictors best matches observed responses. The quality of the fit is measured by the residual sum of squares, the total squared mismatch between predictions and...

Silvia Bartolucci, F. Caccioli, F. Caravelli et al. · 0 citations
Preprint Sep 2026

Orthogonal Moments in Likelihood Models

Many models, such as fixed-effect models for panel or network data, are hard to estimate because they feature nuisance parameters that are both numerous and estimated imprecisely. This, in general, causes an incidental-parameter problem in the estimator of the parameters of interest. The problem can be alleviated by wo...

Stéphane Bonhomme, K. Jochmans, M. Weidner · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.