The Adaptive Knowledge Distillation Framework (AKDF), a unified training approach that simultaneously com-presses LLMs and embeds ownership signals for copyright assurance, is introduced, providing a practical path to-ward bandwidth-efficient and ownership-aware deployment of large-scale language models.
Feng Jiang, Hong-Hui Xu, Daehee Seo et al.· Tsinghua Science and Technol...· 0 citations
Mixture-of-Experts (MoE) has become a widely adopted architecture for Large Language Models (LLMs), as it improves model capacity while limiting computational overhead through sparse expert activation. This property makes MoE-based LLMs particularly attractive for resource-constrained distributed environments. However,...
Ting-Qi Wang, Hongyu Ke, Hao-Xin Wang et al.· 0 citations
ClinX is introduced, an end-to-end multimodal PHI sanitization framework for medical image-text data, and results show that OCR-only masking is not sufficient as a standalone solution, and restoration-based sanitization better preserves clinically relevant visual context while sharply reducing recoverable PHI.
S. Shrestha, Zongxing Xie, Chen Zhao et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.