Author

A. van den Hengel

h-index 16 View on Semantic Scholar

We have 2 of 41 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

Lasting Effects of Abstract Pretraining Beyond Perplexity

Language models are typically pretrained from random initialization. Recent work challenges this convention, showing that a brief warm-up on abstract, algorithmically generated data can provide a better starting point for subsequent learning of natural language. In this paper, we show that in small language models, suc...

Zachary Shinnick, Hemanth Saratchandran, Damien Teney et al. · 0 citations

Jul 2026

Back from the Future: Key-Value Cache Management by Counter-Causal Surprise

Key-value (KV) cache management through compression and eviction strategies has emerged as an important research direction in recent years. Computational demands of large language models (LLMs) and their multi-modal variants during output generation can be partially alleviated by caching previous key and value calculat...

Stephen Gould, A. van den Hengel · arXiv.org · 0 citations