Quizzing the Translation: A Prover-Grounded Evaluation Metric for NL$\rightarrow$FOL
On 434 expert-audited real LLM translations, SIV attains the top AUC, uniquely detects and grades expert-labeled major errors, and abstains, rather than mis-scoring, on out-of-vocabulary translations.
Pu-Yi Suo, Ali Emami
· 0 citations