Vibe Patenting: Evaluating LLM Judges for Professional Patent-Drafting Agents
Vibe Patenting, an end-to-end patent-drafting testbed for AI-agent evaluation, validates the judge against independent evaluation by a professional patent attorney and finds meaningful but strongly metric-dependent agreement and systematic calibration differences.
T. Koike-Akino, Vladislav Blaykhman, Wang Ye et al.
· 0 citations