Skip to content
Preprint

PRMU: A Corpus-Free Benchmark for Person-Centric Knowledge Unlearning in Multimodal Large Language Models

Aug 2026 · 0 citations · 20 references
Computer Science

TL;DR

This work introduces PRMU, a benchmark for evaluating corpus-free multimodal unlearning under realistic person-centric deletion requests, and introduces Similarity-Gated Projection Editing (SGPE), a lightweight corpus-free unlearning baseline with knowledge displacement, protected parameter-space editing, and locality-aware multimodal control.

Abstract

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in storing and recalling rich person-related knowledge, raising increasing concerns about reliable knowledge removal. However, existing machine unlearning approaches for MLLMs typically assume access to original forget and retain corpora, which are often unavailable in realistic deletion scenarios. To address this limitation, we introduce PRMU, a benchmark for evaluating corpus-free multimodal unlearning under realistic person-centric deletion requests. PRMU focuses on naturally acquired person-related knowledge and evaluates whether models can remove target knowledge while preserving related knowledge through diverse textual and visual probes, including adversarial evaluation and fine-grained locality analysis. To facilitate research in this setting, we further introduce Similarity-Gated Projection Editing (SGPE), a lightweight corpus-free unlearning baseline with knowledge displacement, protected parameter-space editing, and locality-aware multimodal control. Extensive experiments on representative MLLMs reveal that existing unlearning methods often suffer from unfavorable forgetting-locality trade-offs, with significant locality degradation under aggressive forgetting settings, and remain vulnerable to multimodal knowledge reactivation. Meanwhile, SGPE provides a competitive trade-off between target forgetting, locality preservation, and general multimodal utility. We hope PRMU can facilitate future research toward realistic and scalable multimodal machine unlearning. Code and dataset will be released at https://github.com/2231122/PRMU.

View source

Similar papers

Preprint Aug 2026

Toward Fine-Grained Forgetting:Attribute Unlearning for Multimodal Large Language Models

This work proposes Causal Localization and Retain-Aware Projection (CLRP), a lightweight training-free framework that uses activation patching to identify the layer that causally mediates target-attribute disclosure, then applies a retain-aware projection that removes the target-attribute subspace while preserving same...

Junkai Lin, Junkai Chen, Siqi Hou et al. · 0 citations
Preprint Aug 2026

Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation

UNLINK-VL is introduced, a real-world benchmark for cross-modal knowledge unlearning in VLMs that demonstrates that relying solely on intra-modal evaluation, particularly text-only evaluation, may substantially overestimate the effectiveness of knowledge unlearning in VLMs, underscoring the need for cross-modal unlearn...

Chun-Lin Liu, Jun-Nian Chen, Haitong Jiang et al. · 0 citations
Open access Sep 2026

Forbid Your Attention: Fooling Multimodal Large Language Models by Selectively Removing Intrinsic Focus in Spectral Domain

Multimodal large language models (MLLMs) have extended the capability of large language models (LLMs) to process more contextual multimodal information, showing remarkable progress in diverse realistic multimodal applications. Despite their strong perception and reasoning abilities, recent studies reveal that MLLMs rem...

Dai-Zong Liu, Junhao Dong, Zhi-Yuan Ma et al. · 0 citations
#computer vision Preprint Aug 2026

AIM: Anchor Identity Features, Then Match for Multimodal Large Language Model Unlearning

AIM is proposed, a two-stage method that anchors an identity-forgetting target with a universal visual prompt and then matches the vision encoder to that target under a Fisher-based constraint, which achieves competitive identity forgetting while preserving non-deleted identities, prior knowledge, and visual perception...

Wonjun Lee, Jaehyuk Jang, Kangwook Ko et al. · 1 citation
Preprint Aug 2026

Exploring and Bridging Knowledge Holes in Unlearned Multimodal Large Language Models

This work constructs a benchmark that captures unintended degradation on benign inputs sharing generic patterns with the forget set, and proposes Selective Protection with Anchored Regularization, which protects generic patterns via anchored activation filtering while reinforcing them through entity-abstracted enhancem...

Junxian You, Junkai Chen, Yuhao He et al. · 0 citations
Preprint Aug 2026

Beyond Global Editing: Per-Instance Disentangled Subspaces for Training-Free Hallucination Mitigation in LVLMs

This work proposes a training-free hallucination mitigation framework for dynamic, per-instance suppression at test time, and proposes a dynamically combined projection that selectively suppresses the most probable hallucination directions while preserving image-grounded semantics.

Ali Cheraghian, Hamidreza Dastmalchi, Hamed Barzamini et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.