Marcelo Saval-Calvo

Are We Really Doing Few-Shot Learning? A Critical Examination of Pre-Training Assumptions

The results show that class disjointness alone is insufficient to remove the influence of target-domain data, highlighting the need to move beyond in-domain pre-training as the default few-shot evaluation protocol, since it can overestimate performance in realistic scenarios where target-domain data are scarce.