The continued scaling of deep neural networks (DNNs) is driving accelerator architectures toward chiplet-based integration. However, conventional fixed and workload-level optimized topologies do not track fine-grained, time-varying communication during DNN inference, resulting in multi-hop latency and link congestion....
Xun Nie, Hua-Xi Gu, Rui-Zhen Pan et al.· Journal of Lightwave Technol...· 0 citations
Mixture-of-experts inference introduces fine-grained, dynamically changing many-to-many communication for token dispatch and collection, making serving latency highly sensitive to the interconnect. Optical circuit switching (OCS) offers an optically transparent data plane, but its benefits for MoE depend critically on...
Shuo Li, Hua-Xi Gu, Yi-Xuan Hao et al.· Journal of Lightwave Technol...· 0 citations
Optical-circuit-switched interconnects have become one of the core components for AI training due to their flexible topology reconfiguration. In contrast to the applications carried by traditional data center networks, large-scale language model training is highly sensitive to network failures, where frequent disruptio...
Liang Qin, Xing-Yu Liu, Wen-Ting Wei et al.· IEEE Transactions on Cogniti...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.