Skip to content

The Price of Thought: Does Test-Time Reasoning Pay in LLM Trading?

Sep 2026 · 0 citations · 45 references
Computer Science

TL;DR

It is shown that additional reasoning can change financial decisions without reliably improving their economic value, motivating validation for each task before deployment.

Abstract

While inference-time reasoning in large language models (LLMs) promises better decision making, its higher computational cost may not yield better economic outcomes. Yet reasoning controls are rarely evaluated as economic interventions, where changes in model outputs must translate into better portfolios after trading costs. We conduct a controlled study of representative LLMs from the DeepSeek, GPT, and Gemini families. We vary reasoning effort while holding information available at each formation date, prompts, output formats, and portfolio construction fixed. Our evaluation covers a full year of U.S. equities under three input conditions: numerical, identifiable news, and masked news. It includes more than 800,000 asset predictions and repeated model generations. Across all three model families, additional reasoning does not produce a reliable improvement in net portfolio returns. For DeepSeek, where we examine the full progression from no reasoning to maximum reasoning, performance is nonmonotonic. Repeated generations also produce unstable treatment effects and portfolio selections, even when overall scores remain similar. These findings show that additional reasoning can change financial decisions without reliably improving their economic value, motivating validation for each task before deployment.

View source

Similar papers

#artificial intelligence Preprint Oct 2026

What Effort Level Should I Choose? On the Economics of Reasoning Effort in LLM Agents

Generative models increasingly expose a reasoning effort setting that lets users scale inference-time compute, trading higher cost for potentially improved performance. Users must choose an effort level before knowing whether extra reasoning will help, and even a successful run does not reveal whether the effort purcha...

Kaiser Sun, Yongchan Kwon, Zainudin Hasan et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Beyond Behavioral Accuracy: Evaluating Individual-Level Fidelity in LLM Investor Simulation

Large language models (LLMs) are increasingly used as user simulators, but can they faithfully reproduce an individual's behavior and decision logic over time? We investigate this question in a longitudinal paper-trading study with 80 participants. Using rolling next-day predictions, we evaluate trading activity, buy-s...

Jia-Jie He, Y.-H. Jiang, Xin-Tong Chen et al. · 0 citations
Preprint Oct 2026

AStockArena: Beyond Returns, Can We Entrust Real Capital to the Decisions of Financial Agents?

Large language models (LLMs) are increasingly used in dynamic financial trading, yet real-time trading benchmarks mainly evaluate agents by cumulative returns and risk-adjusted performance. Such outcome metrics cannot show whether trades are faithfully reported, supported by available evidence, and consistent with acco...

Ze-Yu Liu, Sing-Kwong Lai, Xuan-Zhi Feng et al. · 0 citations
Preprint Oct 2026

Quant-Arena: Benchmarking LLM Agents for Quantitative Trading Research

Quantitative research is an iterative loop: a researcher proposes a market hypothesis, implements it as an executable signal, tests it on historical data, and decides what to keep. Existing benchmarks score formulas, code, or individual trading decisions, leaving open whether large language models (LLMs) can complete t...

Hou-De Qian, Zheng Jiang, Wen-Yi Li et al. · 0 citations
Preprint Oct 2026

Not All Test-Time Compute Is Evidence: Model-Specific Bias in LLM Reasoning

Test-time scaling methods implicitly assume that additional computation from the same model provides independent evidence. We show that this assumption fails within a single reasoning model: errors are correlated across repeated samples, across reasoning depth, and in the model's own self-evaluation, so more compute fr...

Ming Shen, Tian-Jun Yao · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.