A Measurement Study of LLM Inference Trade-offs Across Edge Continuum Hardware
Large language models (LLMs) are increasingly used as backends for intelligent web services, but serving them across the edge continuum requires balancing quality, latency, model footprint, and energy. This paper presents a controlled measurement study of self-hosted LLM inference across edge and near-edge deployment n...
Maysam Khatib, Moysis Symeonides, Demetris Trihinas et al.
· 0 citations