Skip to content

Self-distillation framework via historical collaborative learning for image classification

Jul 2026 · Pattern Analysis and Applications · Vol 29 · 0 citations · 66 references
Computer Science

TL;DR

This work proposes a novel Historical Collaborative Learning (HCL) framework empowered by adaptive dual-state historical supervision that jointly exploits long-term and short-term historical knowledge to produce complementary supervision signals.

View source

Similar papers

Open access Aug 2026

Enhancing self-supervised representation learning through lightweight learnable data augmentation

A lightweight learnable augmentation framework based on Extreme Learning Machines for self-supervised visual representation learning that improves linear evaluation performance relative to reproduced baselines across most settings and demonstrates that lightweight learnable augmentation can effectively enhance self-sup...

Mubarakah Alotaibi · 0 citations
Preprint Aug 2026

Self-Supervised Representation-Guided Generative Dataset Distillation

Self-supervised representation-guided generative dataset distillation (SRG) is proposed, a framework that translates the SSL geometry into diffusion guidance and consistently outperforms the evaluated generative baselines across multiple datasets and IPC settings.

Mingzhuo Li, Guang Li, Linfeng Ye et al. · 0 citations
Aug 2026

Self-supervised skeleton action recognition based on graph prototype learning

This work presents a novel self-supervised architecture centered on graph prototype learning that sets a new state-of-the-art on the ARMM dataset with an accuracy of 95.70%, substantiating the efficacy and transferability of prototype-guided self-supervised learning for skeleton-based action representation.

Zhijie Xu, Hong-Wei Chen, Xia Li · 0 citations

with Pretrained Generative Model for Self-Supervised Learning

GenView is presented, a controllable framework that augments the diversity of positive views leveraging the power of pretrained generative models while preserving semantics, and an adaptive view generation method that dynamically adjusts the noise level in sampling to ensure the preservation of essential semantic meani...

Xiao-Jie Li, Yi-Bo Yang, Xiang-Tai Li et al. · 0 citations
Open access Sep 2026

Beyond Pseudo-Labels: Dual-Level Knowledge Distillation for Enhanced Deep Clustering

TSDC outperformed existing deep clustering frameworks, yielding improved classification accuracy and the most prominent improvement was observed on CIFAR-100, where classification accuracy rose from 54.77 ± 0.07 to 57.58 ± 1.85.

Rehab Alnefaie, M. B. Ben Ismail, Ouiem Bchir · 0 citations

Taking lessons from history: Memory Augmented Self Distillation for graph neural networks

This study introduces a novel memory-augmented self-learning framework that extracts and provides diverse learning sources for adaptive knowledge distillation from the student model itself, resulting in a 2.5-6% increase in accuracy across various benchmark datasets compared to current GNN training and self-distillatio...

Saurabh Sharma, Souvik Chowdhury, Joydeep Chandra · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.