MoMaTune: Model, Match, Then Tune Language Models for Numerical Records
Despite remarkable progress in language understanding and generation, decoder language models continue to exhibit striking failures on numerical data. Numerical examples are typically serialized as text by concatenating feature names with their values (e.g., fat:3.4), while conventional task adaptation applies loss onl...
Weimin Lyu, Jing-Fen Zhang, Ling-Dao Sha et al.
· 0 citations