From Token Probabilities to Semantic Constraints: Towards Declarative Probabilistic Evaluation of Language Models
A declarative probabilistic framework for pre-training evaluation that makes the semantic structure of model behavior explicit and provides new formal tools for relating evaluation to learning, and links evaluation and learning through a shared semantics.
Kyle Richardson, C. Anderson, Pranav Balakrishnan et al.
· 1 citation