Skip to content

Global Logic and Local Search: Dual-Stream Multimodal In-Context Learning for Verifiable Industrial Anomaly Detection

Jul 2026 · arXiv.org · Vol abs/2607.03817 · 0 citations · 45 references
Computer Science

TL;DR

This work presents GLLS, a training-free framework for reference-guided multimodal in-context verification that combines a Global&Logic Stream, where SAM 3 extracts partially checkable visual facts, with a Fine-Grained&Actions Stream, where MCTS selects local evidence crops under a fixed budget.

Abstract

Large Multimodal Models (LMMs) show strong few-shot generalization, but industrial anomaly detection remains difficult because defects are small, input resolution is limited, and textual standards are not always grounded in visual evidence. Recent optimization-based methods improve alignment through fine-tuning, but they often require many defective samples, which are unavailable in early deployment. We present Global Logic and Local Search (GLLS), a training-free framework for reference-guided multimodal in-context verification. GLLS uses a Part-Aware Visual-Logical Atlas to organize normal references and structured specifications in the inference context. It combines a Global&Logic Stream, where SAM 3 extracts partially checkable visual facts, with a Fine-Grained&Actions Stream, where MCTS selects local evidence crops under a fixed budget. Experiments on MMAD-QA and additional anomaly detection datasets show consistent gains over matched and general-purpose baselines, while keeping the final diagnostic decision traceable to explicit visual evidence throughout the inspection trace.

View source

Similar papers

Sep 2026

GRPO-Anomaly: Reinforcement Fine-Tuning Vision--Language Model for Industrial Defects Detection and Reasoning

Industrial anomaly detection (IAD) requires reliable identification and precise localization of subtle defects, yet most existing methods depend on manually tuned decision thresholds and large collections of defect-free samples, limiting scalability in real-world production. To address these constraints, we present gro...

Yue-Ning Li, Hong-Liang Wang, Peng-Fei Xiu et al. · 0 citations
Open access Aug 2026

Myriad: a large multimodal model applying vision experts for industrial anomaly detection

A novel large multimodal model applying vision experts for industrial anomaly detection (abbreviated as Myriad), which treats conventional IAD models as VEs and converts their anomaly maps into lightweight prompts that steer a frozen Q-Former toward suspicious regions, while a compact low-rank adapter shapes features f...

Yuanze Li, Haolin Wang, Shihao Yuan et al. · 0 citations
Preprint Sep 2026

Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space

Anomaly-LR is proposed, a defect-grounded latent reasoning framework that first forms a global understanding of the input and then progressively refines anomaly-relevant representations directly in the visual latent space, and achieves state-of-the-art performance among comparable-scale methods across multiple IAD benc...

Jaron Yeh, Yen-Wei Chang, Jiang Liu et al. · 0 citations
Preprint Aug 2026

InspectorGPT: A Comparative Reasoning Enhanced VLM for Comprehensive Industrial Anomaly Detection

InspectorGPT, a VLM framework centered on comparative reasoning, is proposed, which demonstrates superior multi-dimensional performance and generalization to unseen benchmarks, validating comparative reasoning for comprehensive industrial inspection.

Weifeng Chen, Hong-Hao Zhang, Zhiyuan You et al. · 1 citation
Preprint Aug 2026

LLM as Detector: An In-context Learning Approach for Tabular Anomaly Detection

LLM-Detector is proposed, a framework that utilizes the in-context learning capacity of LLMs for structured, prompt-conditioned scoring synthesis, enabling LLMs to derive anomaly detection logic from structured normal-state knowledge.

Tu Nguyen, Dang Nguyen, T. D. Le et al. · 0 citations
#small language model Open access Sep 2026

Adaptive multimodal large language model with hierarchical cross modal grounding for real time industrial visual anomaly detection on edge devices

The HCG-MLLMAD - Hierarchical Cross-Modal Grounding framework of Multimodal Large Language Model-based Anomaly Detection - a variant of the original Light-MLLMAD architecture with multi-scale visual feature pyramids, prompt routing, and a hierarchical cross-attention fusion mechanism is presented.

P. Sundaravadivel, U. Kumaran, E. S. Vinoth Kumar et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.