Cascadia: Resident 975B MoE Inference on Eleven AI PCs
This work presents Cascadia's resident execution of Inkling, a 975B-total/41B-active-parameter model, and contributes a custom resident MoE engine that preserves Inkling's routing rules, constructs compressed graphs for OpenVINO's fused iGPU primitives, and coordinates FP16 expert computation with FP32 output restorati...