Si-Yuan Dai

Interpretable multimodal learning for integrating neuroimaging and genetic data in Alzheimer’s disease

R-GenIMA, an interpretable multimodal large language model that pairs a region-of-interest vision transformer with genetic prompting to jointly analyze structural MRI and single nucleotide polymorphisms, shows that interpretable multimodal AI can integrate imaging and genetics to reveal disease mechanisms.