MM-OPD is introduced, a multimodal on-policy self-distillation framework for symbolic-to-visual correction that transfers guidance from symbolic-conditioned behavior to the image-conditioned policy through residual token-level targets, steering the model toward correct visual evidence.
Jin-Tao Tong, Yujing Lou, Zhan-Ming Shen et al.· 0 citations
TailSieve, a partial-rollout-guided framework that jointly controls tail routing and replica allocation for LLM rollouts, and shows that makespan-optimal routing in the long-tail regime combines tail isolation with load balancing, and that a simple top-k policy closely approximates this offline optimum.
Tianqi Xu, Lu Lv, Hao-Yang Huang et al.· 3 citations· ⚡1
FCCA, which estimates the signed input--error cross-covariance, whitens it with diagonal Fisher moments, truncates it in the resulting local metric, maps the selected directions back, and applies thin QR to obtain stable core coordinates, shows that a carefully selected fixed span can recover most of the benefit of mov...
Wen-Song Ye, Zhan-Ming Shen, Zhiqing Xiao et al.· 1 citation· ⚡1
This work conducts a fine-grained analysis of hallucinations arising in LLM reasoning and finds that the reasoning traces are particularly prone to Context-Sensitive Factual Hallucinations: cases where the model actually has the relevant knowledge, yet makes factual errors due to contextual interference during reasonin...