VakyArth: Evaluating Pragmatic Competence in LLMs across Indic Languages
Real-world communication often requires pragmatic reasoning: interpreting meanings implied through context and cultural convention rather than stated literally. Existing pragmatic evaluation remains largely limited to English and high-resource languages, leaving Indic languages unexplored despite their linguistic and c...
Usneek Singh, Poorvaja Veera Balaji Kumar, Parth Nanda et al.
· 0 citations