Skip to content

MicroEvo: Knowledge-Guided LLM Sampling for Efficient Microarchitecture Design Space Exploration

Aug 2026 · 1 citation · 38 references
Computer Science

TL;DR

MicroEvo is a knowledge-guided framework that couples off-the-shelf LLMs with Monte Carlo Tree Search (MCTS) for multi-objective microarchitecture optimization and demonstrates strong scalability to a complex industrial-scale core.

Abstract

Microarchitecture design space exploration suffers from expansive search spaces and expensive PPA evaluation, leaving only a small simulation budget for design decision-making. Existing methods perform blind search without considering microarchitectural dependencies and fail to learn from the iterative search effectively, leading to wasted evaluations and weak Pareto convergence. In this paper, we propose MicroEvo, a knowledge-guided framework that couples off-the-shelf LLMs with Monte Carlo Tree Search (MCTS) for multi-objective microarchitecture optimization. MicroEvo combines LLM-driven evolutionary operators, a Pareto-aware tree policy that balances Pareto contribution and diversity, an active knowledge accumulation mechanism that extracts and reuses optimization insights, and state-aware directives that adapt the search behavior online. Experiments show that MicroEvo improves Pareto-front quality by up to 36.2% over NSGA-II and achieves 10.6x higher search efficiency, and also demonstrates strong scalability to a complex industrial-scale core. The code repository is available at: https://github.com/GEAR-SEU/MicroEvo-ICCAD-26.

View source

Similar papers

V ENDI E VOLVE : Towards Diversity-Aware LLM-Guided Evolutionary Search

V ENDI E VOLVE augments LLM-guided evolutionary search with label-free distributional diversity signals that diagnose population-level collapse and keep semantically distinct programs influential as context for future LLM mutations.

Lei Lei, Atharva Sehgal, L. H. Yoon et al. · 0 citations
Preprint Aug 2026

EvoMem: Memory-Augmented Evolution for Code Optimization

EvoMem is introduced, a persistent memory architecture for LLM-based evolutionary program search that captures and reuses candidate mutation knowledge and provides evidence that persistent memory can reduce some redundant exploration and improve the reuse and adaptation of successful strategies in LLM-driven evolutiona...

Viktor Volkov, Valentin Khrulkov, Andrey V. Galichin et al. · 0 citations
#artificial intelligence Preprint Sep 2026

The Inference Engineering Pareto Atlas: Which Optimizations Dominate the Cost, Quality, and Latency Frontier?

A cost, quality, and latency Pareto atlas is built to identify the best configurations for different deployment constraints and shows why speed alone is insufficient in vLLM inference, showing why speed alone is insufficient.

Srikanta Datta Tumkur, Jay Iyer, Mehar Simhadri et al. · 0 citations
Preprint Aug 2026

CAGE: Regime-Aware Algorithm Engineering for Coverage Optimization

The results demonstrate that strategy nondominance is workload- and condition-dependent, supporting regime-aware algorithm engineering rather than a universal policy ranking.

Amirreza Khorasanian · 0 citations
Preprint Aug 2026

ArchAgent v2: A Case Study with the Data Prefetching Championship

This work presents ArchAgent v2, a framework which scales automated microarchitecture search to multi-level data prefetching and introduces two new additions to ArchAgent: a cascaded evolutionary search that subdivides the design space by sequentially evolving and freezing prefetchers at individual cache levels, and a...

Abraham Gonzalez, Raghav Gupta, Akanksha Jain et al. · 0 citations
Preprint Sep 2026

Poseidon: DAG-Guided Parallelism Search for LLM Pre-Training on Heterogeneous Clusters

Poseidon is an efficient and scalable LLM training framework designed with heterogeneity awareness, which employs two efficient, theoretically grounded strategies: stage-level pruning via early stopping with partial estimation, and layer-to-stage mapping exploiting a ridge-like distribution pattern.

Xiao-Song Chen, Shao Nie, Zhong-Min Zhao et al. · 0 citations

Related blog posts

Hugging Face Blog Oct 20, 2026

MPS in PyTorch 2.15

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.