Assessing the Downstream Utility of Evidence-Aware Retrieval in RAG
Making retrieval evaluation more closely reflect the evidence needed for generation does not by itself make every downstream use of that evaluation more reliable, and RAG evaluation methods should be assessed with respect to the particular comparisons, decisions, and conclusions they are intended to support.