Current evaluations of multimodal unlearning typically focus on whether a model stops outputting target information. This surface-level criterion, however, masks two critical failure modes. First, knowledge suppression techniques often induce confabulation, leading the model to hallucinate facts about the unlearned sub...
Hao-Dong Chen, Sheng-Tao Wen, Dong Liang et al.· 0 citations
Multimodal diffusion language models generate responses by iteratively unmasking tokens, making each answer the endpoint of a multi-step trajectory rather than an immediate commitment. Hallucination benchmarks built for autoregressive models evaluate only the final output, and therefore cannot determine whether an unsu...
Ya-Dong Wang, Si-Ping Yue, Yu Tian et al.· 0 citations
LSTR (Latent Sparse Transcoder Reasoning), a framework that turns sparse transcoders from post-hoc diagnostic tools into in-loop, intervenable transition components for latent reasoning, and suggests that sparse latent transitions can preserve the compression benefits of latent reasoning while making the resulting traj...
Yadong Wang, Hao-Dong Chen, Yu Tian et al.· 0 citations
Recall-Anchored Distillation (RAD), a base-anchored self-distillation objective that preserves out-of-distribution generation behavior by aligning the adapted model with the original base model's soft continuation distribution on unlabeled OOD text, is introduced.
Hao-Dong Chen, Ya-Dong Wang, Sheng-Tao Wen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.