Disassociating performance from compositional feature learning
The results show that even with appropriate biases and near-perfect OOD accuracy, a model can fail to learn the compositional feature structures necessary for systematic generalisation, indicating that OOD benchmarks alone are insufficient for evaluating compositionality in neural networks.
G. Dimitriadis, Spyridon Samothrakis
· 0 citations