Accelerated LLM: A Fuzzy-Logic-Augmented Router Architecture for Efficient Multi-Domain Query Processing via Specialised Small Language Models
Accelerated LLM, a modular architecture that replaces a single general-purpose LLM with an ensemble of task-specialised small language models (SLMs) governed by a neural query router and a Mamdani fuzzy inference system, achieves competitive or superior task-specific performance at a fraction of the parameter count.
Kushagra Agrawal, Deshmukh Nirmiti Akshay, Palak Kaushik et al.
· Machine Learning and Knowled... · 0 citations