Preprint
Aug 2026
TACTICL: Task-Aware Compression of Tabular ICL Models
TACTICL is introduced, an automated task-aware compression framework for tabular in-context learning models that jointly prunes transformer layers and replaces them with lightweight adapters trained on downstream tasks, thus blending in-context with in-weight learning.
Mykhailo Koshil, Matthias Feurer, Katharina Eggensperger
· 1 citation