Do Language Models Update their Forecasts with New Information?
It is found that while models often track the correct update direction, their quantitative shifts remain heavily under-responsive and both verbalized and logits-based confidence estimates are poorly calibrated compared to the human reference standard.
Moy Yuan, Zifeng Ding, Andreas Vlachos
· 2 citations