Empowering On-Device Model Adaptation with an Edge AI Inference Accelerator
A heterogeneous adaptation pipeline that repurposes a commercial edge AI inference accelerator, Hailo-8L, for frozen-backbone feature extraction during on-device training, and post-training quantization restoration is shown to be crucial for preserving the quality of accelerator-generated features and mitigating accura...