Safwan Kamal

Matched data, small gaps: a pre-registered comparison of fine-tuned classifiers, retrieval-prompted language models and a typed-decision model for intent and out-of-scope decisions

Before an assistant acts on a message, it decides whether the message is something it handles (scope) and what it asks for (intent). We ask which kind of system should make that decision given the same in-scope labelled data, and what moves a prompted model's scope decision. We compare a fine-tuned 150M classifier with...