Xiaowen Cao

Pruning-Aware Multi-Cluster Co-Inference for Large AI Models in AI-RANs

A multi-cluster LAIM co-inference framework, where an edge server equipped with multiple graphics processing units (GPUs) coordinates multiple user clusters to execute inference tasks collaboratively, significantly outperforms existing benchmark schemes, achieving superior inference accuracy and resource efficiency in...