Bo Lang

Semantic Prior Smoothing for Conformal Prediction in Multiple-Choice Question Answering with API-Only Large Language Models

We study conformal prediction (CP) for multiple-choice question answering (MCQA) with large language models (LLMs) accessed only through application programming interfaces (APIs), where internal logits and token probabilities are unavailable. Candidate probabilities are often estimated from repeated answer samples, but...