Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems
Litmus is a zero-label system that designs evaluation and monitoring metrics for AI pipelines by eliciting evaluation intent from source code and targeted interrogation, and results support a shift from automatic metric implementation to automatic metric specification.
Prajjwal Gupta, Prasang Gupta, Vishal Bhutani et al.
· Proceedings of the 2026 Conf... · 0 citations