Vision-language models (VLMs) face compositional safety risks where harmful intent emerges from the interaction between visual and textual inputs. As mixture-of-experts (MoE) VLMs become increasingly common, recent work has explored various safety interventions, including prompting, supervised fine-tuning, and routing-...
Zi-Yuan Yang, Wen-Xuan Ding, Shang-Bin Feng et al.· 0 citations
It is established that principled and informed team selection is critical and strong model selection algorithms for assembling effective multi-LLM systems are presented.
Zong-Wan Cao, Zi-Yuan Yang, Shang-Bin Feng et al.· 0 citations
This work studies interventions at four levels of group-policy RL pipelines---data, rollout, reward, and advantage---and conducts extensive RL training on saturated reasoning data only, demonstrating that don't waste your saturated data: with the right strategies they can be recycled into useful RL training signals in...