When Specifications Conflict: A Symmetry-Based Framework for Measuring LLM Preferences
The framework provides a unified approach for measuring how LLMs resolve conflicts between competing sources of information, and extends to heterogeneous specification conflicts in Boolean algebra, code generation, and the clinical domain, demonstrating its applicability across diverse tasks and specification forms.