Latent Taxonomies: How Property Induction Develops in Language Model Pre-training
The results show that a model's inductive generalization reflects the latent organization of its training data, with implications for data curation and for predicting how far a learned fact will spread.