Reward Design for Physical Reasoning in Vision-Language Models
It is found that external rewards drive most of the accuracy gains, while preserving more coherent reasoning when rewarded for reasoning tokens, while preserving more coherent reasoning when rewarded for reasoning tokens through internal attention rewards.