PAC-NoC: A Hierarchical Network-on-Chip for Efficient Parallel Aggregated Communication in Transformer Accelerators
In the era of Transformers and large language models (LLMs), communication bandwidth has superseded compute capability as the dominant architectural bottleneck. These workloads require frequent aggregated multicast, requiring the simultaneous delivery of distinct data streams to multiple processing element (PE) cluster...