Evaluating Semantic Relation Knowledge through Bidirectional Relation Prediction from Gloss Pairs
A challenging task in which an LLM predicts the relation between two glosses (definitions of senses) presented in two different orders, suggesting limitations in current LLMs's semantic relation knowledge, both in identifying relations and in respecting asymmetry.
Zhi-Han Cao, Adam Nohejl, Hitomi Yanaka
· 0 citations