Preserving Membership Privacy via Risk Score Guided Knowledge Distillation
RS-KD is proposed, a defense mechanism that dynamically adapts the distillation process according to a privacy risk score estimated from the output characteristics of a teacher model, allowing the framework to selectively regulate the uncertainty introduced during distillation.