Temporal Evidence-Parameter Co-Alignment (TEPCA), a framework for LLM reasoning over TKGs that aligns LLM reasoning with temporal knowledge at both the evidence and parameter levels, and enables LLMs to better capture fine-grained entity evolution and time-dependent relation semantics while preserving parameter efficie...
Large Language Models (LLMs) depend fundamentally on the diversity, depth, and factual rigor of their pre-training corpora. However, contemporary foundational pre-training datasets (such as The Pile, S2ORC, and Dolma) exhibit a severe structural omission: African scientific, medical, legal, and agricultural scholarship...
It is suggested that the evaluated LLMs respond to surface cues rather than to the mechanisms that make a passage manipulative, which would suggest that the evaluated LLMs respond to surface cues rather than to the mechanisms that make a passage manipulative.
Multilingual evaluations often score a model's opening yes or no, a token that also carries model and language answering conventions. We ask when different ways of eliciting and reading an answer recover the same judgment, and when they measure an answer habit. We collect 1.1 million replies from eight models in six la...
Haonan Huang, Yuwei Lu, Chengkun Cai· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
A diagnostic study finds that stronger teacher--student agreement in intermediate transitions is associated with higher answer correctness within questions, with correct responses exhibiting lower mean transition KL across all measured intermediate layer pairs.
Run-Yang You, Yong-Qi Li, Tie-Zheng Yu et al.· 0 citations
It is found that polarity blindness affects most evaluated models, and the effect persists across typologically differing negation systems, suggesting that polarity blindness reflects a broader limitation in semantic robustness rather than a language- or grammar-specific failure.
Diego Miguel Lozano, Erik Derner, J. A. Pérez-Ortiz et al.· 0 citations
Large Language Models (LLMs) are increasingly used as research collaborators for hypothesis refinement, methodological planning, and technical analysis across multi-turn interactions. In this setting, a useful assistant must be accurate, methodologically justified, logically consistent, and token-efficient. Current ali...
Sasi Kiran Gaddipati, Gollam Rabby, S\"oren Auer· 0 citations
Word error rate (WER) assigns equal cost to lexical edits despite their different semantic consequences, while overall semantic scores cannot identify which individual errors alter the intended meaning. We formulate ASR semantic evaluation as context-aware, segment-level consequence assessment and propose Semantic Segm...
Xiaoyu Gu, Chencheng Wang, Fuyang Li et al.· 0 citations
Large language models (LLMs) are increasingly used as judgment assistants and as stand-in participants in psychology experiments, yet little is known about how much their probability estimates move in response to a single new piece of information. We pair premise-hypothesis items from $\delta$-SNLI with one strengthene...
Large language models are expected to estimate their own uncertainty, with confidence signals used to guide retrieval, adaptive compute allocation, routing, and selective abstention. We investigate whether confidence signals measured at different temporal stages of problem solving encode distinct forms of epistemic inf...
Sahil Kale· Proceedings of the 10th Wide...· 0 citations
In object goal navigation (ObjectNav), an embodied agent must find a target object (e.g., "find a bed") in a previously unseen environment, relying on spatial commonsense such as object co-occurrence. Large Language Models (LLMs) encode this commonsense, but deploying them on robots exposes a trade-off between reasonin...
Pengying Wu, Zhejia Wen, Kang Ding et al.· 0 citations
This work ablate a production pipeline that turns conference speech into question-answer pairs, and finds that more than a third of its pairs carry knowledge that neither of two frontier models produces on its own.
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.