Ramon Kaspar

DistillPath: An Efficient 22M Distilled Pathology Encoder Approaching Large Foundation Model Performance

Many high-performing pathology tile encoders are now foundation models with hundreds of millions to over a billion parameters. Encoding and storing the thousands of tiles in each whole-slide image with such models is costly on commodity hardware, so compact encoders that retain useful downstream performance are a valua...