Aligning Language Models Towards Counterfactual Invariance
This work develops a policy gradient technique involving a group-level reward function that operates on matched pairs of counterfactual prompts that reduces counterfactual differences while preserving overall response quality and proves that the models continue to adapt appropriately when such sensitive information is...