Judging by the Cover: Cleaning LLM Truthfulness Benchmarks to Avoid Surface-Level Feature Leakage
This work releases a version of TruthfulQA with surface-feature leakage reduced close to chance and provides a mechanism, Audit-Prune, so that the datasets can be cleaned before release.