CAMEL: Fixed-Work Residual Memory for CPU-Oriented Language Models
CAMEL investigates external residual memory for small language models intended for CPU execution. The main study uses a recurrent byte-level student with two compiled memories: an exact surface 4-gram memory and a learned latent residual memory. A 32-byte table selects between the two using support-count bins.On three...