There is not enough public evidence for us to confidently state that midtraining can address the core difficulties inherent in aligning powerful AI systems, and it is believed that demonstrations must be present either in midtraining or post-training datasets for these rules to be robustly learned.
Sid Baines, Jonathan Bostock, M. Martínez et al.· 1 citation
Results show that inoculation with a learned association introduced via midtraining can shape selective generalisation, and more work is needed before this approach can become a load-bearing component in a developer's safety framework.
Kyle O'Brien, Edward James Young, Puria Radmard et al.· 0 citations
The Activation Controllability Benchmark is introduced to quantify the extent to which models can modulate their residual stream via natural-language instruction, and suggests that control over the activation space itself could become a confound for monitoring as introspective capabilities increase.
Marek Mateusz Kowalski, J. Rivera, Uzay Macar et al.· 1 citation· ⚡1
An unsupervised psychometric pipeline is introduced that recovers four interpretable behavioural factors from model rollouts that can be considered in terms of learning, scaling, and composing traits in weight space, providing a bridge between personality measurement, model editing, and safety.
L. Baines, Anton Gonzalvez Hawthorne, Mariia Koroliuk et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.