Zero-shot component recognition for transmission lines in industrial park microgrids based on permutation-attention transformer and lightweight VLM

Abstract

Existing transmission line component recognition methods mostly adopt closed-set detection paradigms and rely on large-scale annotated data. They fail to accommodate diverse equipment models and emerging defects in complex industrial park scenarios, and their fault recognition results cannot support comprehensive operation and maintenance decision-making. To address these issues, this paper proposes a two-stage open-world component recognition method for industrial park microgrid inspection. In the first stage, a lightweight Transformer detector coupled with permutation attention and deformable convolution is constructed to enhance the feature extraction capability of small-scale components and suppress complex industrial background interference. In the second stage, a lightweight vision-language large model (VLM) is introduced to build a multi-task inference framework of "component recognition—defect diagnosis—public health risk assessment—financial analysis". It performs zero-shot recognition of unseen components and novel defects, and combines industrial park scene semantics to analyze personnel health and safety risks, power outage impacts, maintenance costs and economic losses that may be caused by transmission line faults, generating structured fault diagnosis and decision-making reports. Furthermore, a contrastive learning-based domain-adaptive feature alignment strategy is designed to mitigate domain shifts in industrial park scenarios and reduce annotation requirements for target domains. Experimental results show that the proposed method achieves 96.2% mAP@0.5 for known classes and 82.5% zero-shot recognition accuracy on the self-built industrial park transmission line dataset, outperforming mainstream real-time and zero-shot detection methods. It can provide technical support for intelligent inspection and comprehensive operation and maintenance decision-making of industrial park microgrids.