DOPS: Dynamic OPerator Sorting for Heterogeneous NPU-PIM LLM Inference
DOPS is a simulation and analysis framework for heterogeneous NPU-PIM large language model inference. It builds stage-aware execution graphs, evaluates dynamic operator placement policies, explores persistent weight layouts, and exports schedule summaries plus operator and communication traces.
Jiaqi Yang, Jiayi Li, Yihan Fu et al.
· Zenodo (CERN European Organi... · 0 citations