Activation-Conditioned Self-Distillation (ACSD), which extracts a steering vector by contrasting activations of self-generated trajectories that reach verified correct answers within a generation budget with those of all remaining trajectories, achieves the highest mean accuracy over four mathematical benchmarks among...
Preliminary results reveal substantial differences in safety-utility calibration across models and show that failures can emerge only after several initially safe interaction steps, motivating treating agent safety as a trajectory-level property rather than a single-turn or binary success criterion.
Sadia Asif, Mohammad Mohammadi Amiri, Momin Abbas et al.· 1 citation
The architecture family implementing this function class is named CoFrGeNets - Continued Fraction Generative Networks, and novel architectural components based on this function class that can replace Multi-head Attention and Feed-Forward Networks in Transformer blocks while requiring much fewer parameters are designed.
Amit Dhurandhar, Vijil Chenthamarakshan, Dennis Wei et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.