Open access
Aug 2026
Diagnosing Multi-Head Self-Attention: An Information-Theoretic Framework with Application to Time-Series Forecasting
The framework provides a principled diagnostic tool for analyzing selection behavior, inter-head dependence, and head-removal sensitivity in multi-head self-attention and is a diagnostic framework rather than a new forecasting architecture or a standalone pruning algorithm.
Yan-Bin Zhang, Asif Ahmed Essak, Jiao Ding et al.
· Information · 0 citations