Is It Still Worth Training a Classical Model in the Era of LLMs? A Crossover Benchmark on Tabular Data
The labeled-data crossover N*, the training-set size at which a trained classical model's learning curve overtakes a frozen LLM's training-free (and therefore flat) error, is quantified and found that training wins fast.