A LSTM language model learns Hindi-Urdu case-agreement interactions, and has a linear encoding of case
A two-layer LSTM language model trained on 250M morphemes of Hindi data can capture the relatively complex interaction between case and agreement in Hindi-Urdu, and it is shown that this model encodes case-marking linearly, implementing a geometrically intuitive and inter-pretable syntactic processing mechanism.