Do Tabular Foundation Models Still Need Feature Engineering?
A controlled study across several versions of two major TFM families finds a consistent pattern: feature engineering gains are concentrated in earlier model generations and become negligible for the strongest models, suggesting that stronger TFMs depend less on explicitly engineered input representations.