This analysis covers 364,941 responses from three frontier Chinese-based LLMs to 12,165 factual questions derived from real-world Chinese search queries, and evaluates the models with and without reasoning across baseline, belief-conditioned, and anti-sycophancy prompting, tracing matched shifts among correct, incorrec...
Geng Liu, Feng Li, Meng-Xiao Zhu et al.· 0 citations
Results show that strong models can achieve near-complete expected-call coverage on the benchmarked workflows, but reliability depends strongly on both task structure and agent configuration, and practical guidance for deploying local LLM agents in stateful hardware design environments is provided.
It is found that AI assistance increases accuracy by 3-7% when participants viewed the relevant video segment, and by 27-35% when they did not, while efficiency increases by 10% for short videos and 25% for longer ones, and self-reported confidence in answers remains stable across all three conditions.
Anders Giovanni Møller, Elisa Bassignana, Francesco Pierri et al.· arXiv.org· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
