Skip to content

Author

João Monteiro

5 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

On Trajectory-Aware Training for Masked Diffusion Language Models

PUMBA is introduced, a unified framework for trajectory-aware training that trains the denoiser on consecutive steps of policy-induced trajectories, passes information between steps, and optimizes them jointly by backpropagation through time.

Manuel Madeira, Amitis Shidani, Alice Bizeul et al. · 2 citations · ⚡1

KV-Kaizen: Learning Context-Adaptive Cache Compression Choices

This work learns a selector that is able to produce, based on context, a per-layer cache configuration towards an overall compression budget, and achieves the Pareto frontier of accuracy against cache size, against learning-free and post-hoc baselines.

João Monteiro, Louis Béthune, A. Filippova et al. · 1 citation

DynaMiCS: Fine-tuning LLMs with Performance Constraints using Dynamic Mixtures

DynaMiCS is proposed, a dynamic mixture optimizer that casts multi-domain fine-tuning as a constrained optimization problem, and achieves stronger target-domain improvements and higher constraint satisfaction than static, dynamic, similarity-based and probing-based alternatives, without a reference model, per-example s...

Eleonora Gualdoni, Sonia Laguna, Louis Béthune et al. · 2 citations · ⚡1
#machine learning Preprint Sep 2026

KV-Lingo: Learning KV-Cache Translators with Distillation

KV-Lingo can be used for seamless model switching, staying close to re-prefill across repeated switches in the authors' multi-turn evaluations, and is found particularly useful for dynamic model routing.

Valérie Castin, Keitaro Sakamoto, A. Filippova et al. · 1 citation

Cartridges++: KV Cache Compression without Off-Context Derailment

This study investigates the crucial deployment question of whether Cartridges and other CKVs can handle off-context queries, and proposes Cartridges++, simple modifications to cartridges that retain off-context abilities at small or negligible cost.

Sonia Laguna, João Monteiro, Marco Cuturi et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.