Analysis of Multimodal Heterogeneous Graph Transformers for Reconstructing Social Network Structures Based on Open-Source Data
In this paper, transformer-based graph neural networks are applied across different data types, such as text, images, and metadata, to automatically infer the structure of social networks from publicly available OSINT data. A pipeline was built that first processes text with BERT and images with ResNet, then combines t...