Adaptive Self-Consistency: From Black-Box Sampling to Distribution-Valued Feedback
Self-consistency samples many reasoning trajectories and aggregates their final answers, treating the LLM as a black box that returns one answer per trajectory. Yet the final answer of each trajectory is sampled from a softmax vector that is available from the model's log-probabilities. We refer to this as the grey-box...
Jing-Kai Huang, Yun-Fan Zhang, Will Ma et al.
· 0 citations