How Do Prompt Variations Affect Energy Consumption in On-Device LLMs?
This paper aims to understand how two prompt properties, cognitive load and phrasing pattern, shape the energy behavior of on-device LLM inference, and conducts a broad empirical study covering prompt properties, datasets, models, and devices.
Wei-Hao Hu, Xiaolong Tu, Dawei Chen et al.
· 0 citations