Albireo is presented, a detector-agnostic, codec-free adaptive inference framework that wraps off-the-shelf detectors and decides when detector invocation can be safely skipped based on scene content and per-object temporal state, requiring no detector modification or retraining.
Amir Taherin, José Cano, Bin Ren et al.· 0 citations
This paper proposes a vision for telemetry-informed adaptive compression in edge RAG, grounded in experimental evidence, and argues for runtime policies that dynamically manage compression, guided by workload features and edge telemetry.
Z. Feric, Amir Taherin, Yan-Zhi Wang et al.· 0 citations
We present RAGMark, a modular benchmarking framework for advanced Retrieval-Augmented Generation (RAG) systems targeting small-scale multi-GPU environments. RAGMark evaluates diverse RAG components, including retrievers, vector databases, prompt-processing methods, and generator models, while collecting detailed per-st...
Z. Feric, Amir Taherin, Bin Ren et al.· 0 citations
Hydra is presented, a common-schema, phase-aware workload characterization framework for LLM inference on edge SoCs that enables reproducible, phase-aware characterization of edge LLM inference.
Amir Taherin, Sana Taghipour Anvari, Charles Amante et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.