Song-Wei Zhang

A Task-Aware Model Size and Precision Selection Framework for LLM Inference in Edge Computing

Large language models are increasingly deployed in IoT, mobile, and edge-assisted scenarios, where inference is constrained by limited computation, GPU memory capacity, heterogeneous hardware, network conditions, and cloud invocation costs. Existing selection and offloading methods mainly focus on coarse-grained model...