Over-parameterized linear regression has been widely studied over the last decade. However, most existing works assume that the covariates are independent and that their covariance matrices are non-degenerate. In this paper, we relax both assumptions and derive deterministic equivalents for the prediction risk in a van...
Kevin Han Huang, Haoyu Ye, Somak Laha et al.· arXiv.org· 0 citations
Over-parameterized linear regression has been widely studied over the last decade. However, most existing works assume that the covariates are independent and that their covariance matrices are non-degenerate. In this paper, we relax both assumptions and derive deterministic equivalents for the prediction risk in a van...
Kevin Han Huang, Haoyu Ye, Somak Laha et al.· 0 citations
We study the top singular value for a sum of $m$ independent $n \times n$ random matrices, each of which is a product of $N$ i.i.d. $n\times n$ Gaussian matrices. Our main conceptual observation is that when $m,n,N\rightarrow \infty$, the top singular value coincides with the partition function in a random energy model...
Kevin Han Huang, Boris Hanin· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.