A systematic empirical analysis demonstrates that standard metrics including COMET, XCOMET, and BERTScore exhibit near-zero or negative correlation with human cultural judgments, and even display a severity inversion in which scores increase as translation quality deteriorates, and proposes CuRIL, a reinforcement learn...
Yi-Wen Qiu, Linjuan Wu, Ding-Ming Li et al.· 0 citations
Large language models (LLMs) are commonly associated with the distributional hypothesis, according to which (1) semantic meaning is grounded in distributional patterns of linguistic context, and (2) knowledge of cross-linguistic distributional correspondences allows for successful translation. This paper rejects the fi...
Michael Carl· Philosophy of Translation· 0 citations
A novel knowledge graph-based evaluation framework is proposed introducing Semantic Structural Similarity for KGs (S3KG), a hybrid similarity measure integrating structural and semantic similarity into a continuous evaluation score, alongside a diagnostic framework for categorizing reasoning errors.
Subavarshana Arumugam, Mamta Nallaretnam, K. Wickramasinghe et al.· 0 citations
Through PlayTrain, an RL framework that combines the abilities of large language models to robustly generate JavaScript games from a minimal human prompt, and an efficient pipeline that can run any JS game in a standard'gym'environment, this work reimagine RL VGE development.
R. Truong, Lance Ying, Samuel Gershman et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Large Language Models (LLMs) are increasingly deployed in settings where rare but severe harmful generations can have significant consequences. Existing Risk-Averse RLHF addresses this issue by optimizing Conditional Value-at-Risk (CVaR), but it trains policies for fixed risk levels and therefore cannot adjust the desi...
Zi-Xuan Liu, Fangzheng Wu, Brian Summa et al.· 0 citations
Adapting large language models (LLMs) to specialized financial reasoning typically requires expensive fine-tuning that produces model-locked expertise. Training-free alternatives have emerged, yet our experiments show that leading methods (GEPA and ACE) achieve only marginal gains on the FAMMA financial reasoning bench...
Tik Yu Yim, Wenting Tan, Sum Yee Chan et al.· Lecture notes in computer sc...· 0 citations
This work establishes a feedback design strategy that reformulates environments by transitioning from action guidance to observation enrichment during the later stages of both intra-episode exploration and inter-episode evolution, and reveals that FEEs consistently yield performance improvements over standard settings.
This study studies how large language model (LLM)-powered chatbots respond to series of questions about legal reasonableness, and suggests that chatbot responses generally track those of human participants.
Nirav Patel, Emily Wenger, C. Buccafusco· Proceedings of the AAAI/ACM...· 0 citations
A World Values Survey-grounded simulation framework where culturally diverse agents with different communication styles engage in longitudinal, value-laden discussions suggests that current LLM agents can generate plausible conversations, but remain limited proxies for representing and preserving diverse human value pr...
Farah Atif, Sougata Saha, Monojit Choudhury· Proceedings of the AAAI/ACM...· 0 citations
Poster presented at the 10th Research Software Engineering Conference (RSECon26) in Sheffield, UK, 9-11 September, 2026. Abstract The use of generative AI tools to generate source code or to augment a programmer's own code is ever more widespread in research software development. While evidence of associated gains in p...
Philippa Broadbent, T. Mark Hodges, Halford J. W. Dace et al.· Zenodo (CERN European Organi...· 0 citations
Poster presented at the 10th Research Software Engineering Conference (RSECon26) in Sheffield, UK, 9-11 September, 2026. Abstract The use of generative AI tools to generate source code or to augment a programmer's own code is ever more widespread in research software development. While evidence of associated gains in p...
Philippa Broadbent, T. Mark Hodges, Halford J. W. Dace et al.· Zenodo (CERN European Organi...· 0 citations
Poster presented at the 10th Research Software Engineering Conference (RSECon26) in Sheffield, UK, 9-11 September, 2026. Abstract The use of generative AI tools to generate source code or to augment a programmer's own code is ever more widespread in research software development. While evidence of associated gains in p...
Philippa Broadbent, T. Mark Hodges, Halford J. W. Dace et al.· Zenodo (CERN European Organi...· 0 citations
