Post-training expert pruning is a promising deployment technique for Mixture-of-Experts (MoE) models. The calibration set is an integral part of the pruning process, however, its correlation with evaluation performance is largely misunderstood and unintuitive. In this work, we present an empirical study of the robustne...
Luis Frentzen Salim, Chia-Chun Wu, Nhiem Tran et al.· 0 citations
Current neural image compression (NIC) methods primarily focus on signal fidelity optimization. While perceptually optimized codecs can generate decoded images that better align with human visual preferences at equivalent bitrates, they raise authenticity concerns due to potential deviations from the original content....
Yu-Dong Mao, Pei-Lin Chen, Hao Luo et al.· IEEE Transactions on Image P...· 0 citations
This article introduces Uncertainty-Guided Adaptive Knowledge Distillation (UGAKD), a novel framework designed to enhance UDA while simultaneously reducing model size through targeted knowledge distillation and proposing a two-stage, difficulty-aware training scheme to facilitate learning.
Wei-Lun Tseng, Yi-Lun Wu, Yung-Hui Li et al.· ACM Transactions on Intellig...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.