Preprint
Oct 2026
miniTE: Diagnosing and Bridging the Execution Gap in Native NVFP4 Reinforcement Learning
Native NVFP4 promises to accelerate reinforcement learning (RL) for large language models (LLMs), but achieving stable learning across separate training and sampling engines remains challenging. We show that matching model weights and numerical formats is insufficient to ensure consistent policy evaluation, highlightin...
Zhen Li, Ming-Fa Feng, Yi-Ming Zhang et al.
· 0 citations