There has been significant work on understanding the In-Context Learning capabilities of Large Language Models, especially on the induction circuit. For a few-shot classification task, the induction circuit leverages linear representations of each labeled example in-context in order to classify an unlabeled query. Howe...
A. de Senneville, Xavier Bou, J. Anger et al.· 0 citations
Experiments on Gaussian, spherical, and toroidal latent spaces show that geometrically compatible targets yield better linear recovery when optimization succeeds, whereas mismatched targets distort the latent structure.
Léo Nicollier, E. Meinhardt-Llopis, M. Pic et al.· 1 citation
The Unbiased Open World Regularization (UOWReg) framework is proposed, an encoder-only framework that effectively prevents the subpopulation collapse observed in standard SSL, successfully isolating micro-signatures even when heavily entangled with the global structure.
Léo Nicollier, M. Pic, Pablo Mus'e et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.