Long-reasoning Mixture-of-Experts (MoE) models expose two coupled inference bottlenecks: growing KV caches shift the critical path toward attention, while sparse expert activation causes load imbalance and low hardware utilization. Although Processing-in-Memory (PIM) offers a promising way to mitigate data movement ove...
Ru-Bing Yang, Cen-Lin Duan, Ying-Jie Qi et al.· 0 citations
Bayesian Neural Networks (BNNs) offer robust uncertainty estimation capabilities through probabilistic modeling, yet their prohibitively high computational complexity and resource consumption limit deployment in edge computing. In this paper, we propose an FPGA-based BNN inference accelerator that optimizes critical mo...
Xiao-Tao Jia, Bing-Yue Zhang, Zigui Wu et al.· IEEE Transactions on Circuit...· 1 citation
Evaluations demonstrate that MegaGraph enables training on large-scale graphs where state-of-the-art baselines fail due to out-of-memory (OOM) errors, and achieves up to 4.51 times training speedup while maintaining model accuracy.
Tong Qiao, Ao Zhou, Ying-Jie Qi et al.· 0 citations
EcoVLA is proposed, an adaptive device-edge co-inference framework for VLA models that maximizes system energy efficiency under real-time constraints and incorporates a lightweight transmission mechanism for inter-stage intermediate tensors to reduce the communication overhead incurred by cross-device collaboration.
Ao Zhou, Bo Dai, Le Yu et al.· Advanced Parallel Programmin...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.