CROP: Task Relevance via Counterfactuals for Selective On-Policy Distillation
Counterfactual Relevance for On-Policy Distillation is introduced, which operationalizes task relevance through a paraphrase-calibrated counterfactual sensitivity margin and establishes CROP as a model-internal, contrast-specific method for allocating token-level supervision.