Shadab Khan

Mixture-of-Memories: Low-Overhead Language Modeling with Modular Knowledge Injection

Large language models store substantial factual knowledge in their parameters, yet this knowledge is difficult to control, update, and reliably elicit at inference time. Existing memory-augmented approaches typically rely on a single auxiliary mechanism, such as retrieval, parameter updates, or neural memory, and there...