Skip to content

Mach-Mind-4-Flash Technical Report

Jul 2026 · arXiv.org · Vol abs/2607.09375 · 3 citations · ⚡ 1 influential · 78 references
Computer Science

TL;DR

Mach-Mind-4-Flash, a 35B-parameter Mixture-of-Experts (MoE) agentic model with 3B activated parameters, achieves performance on par with or surpassing that of 100B-parameter-class models through post-training optimization alone without scaling pre-training compute.

Abstract

We present Mach-Mind-4-Flash, a 35B-parameter Mixture-of-Experts (MoE) agentic model with 3B activated parameters. Through post-training optimization alone without scaling pre-training compute, the model achieves performance on par with or surpassing that of 100B-parameter-class models. By introducing scalable agentic interaction environments for large-scale reinforcement learning, the model attains significant performance gains on real-world application tasks. Our pipeline comprises three stages: (1) a unified RL/OPD training infrastructure with dynamic multi-teacher scheduling and operator-level acceleration, delivering 17\% end-to-end training speedup; (2) multiple domain-specific RL experts trained in parallel across Reasoning, General, and Agent tracks, then fused into a single generalist via Multi-Teacher On-Policy Distillation (MOPD) -- a routed reverse-KL objective that eliminates the see-saw degradation of mixed-reward RL; (3) Hybrid Median-length Policy Optimization (HMPO), a single-stage token-efficiency method that compresses reasoning chains by 19--46\% with $\le$0.7 percentage-point accuracy loss. Mach-Mind-4-Flash scores 92.70 on AIME'26, 82.82 on IFBench, 80.74 on Behavioral-SafetyBench, 75.80 on BFCL-v4, 72.31 on BrowseComp-zh, and 84.20 on ClawBench -- leading or matching models with 10--30$\times$ its activated size at a fraction of the inference cost.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Pelican-Sim 1.0: A General World Model Simulator for Embodied Intelligence

In this technical report, we propose Pelican-Sim 1.0, a general world model simulator for embodied intelligence that predicts future observations from visual context and robot actions to support downstream learning and decision making. The model incorporates four key design features: (1) Unified action representation:...

Shilong Zou, Shi-Lin Zhang, Yingji Zhang et al. · 1 citation
#artificial intelligence Preprint Sep 2026

Instella-MoE Technical Report

Instella-MoE is introduced, a fully open Mixture-of-Experts (MoE) language model with 16 billion total parameters and 2.8 billion active parameters per token trained entirely from scratch on AMD Instinct MI300X and MI325X GPUs, establishing a strong, fully open foundation for efficient, high-performing MoE models and r...

Jiang Liu, Sudhanshu Ranjan, Prakamya Mishra et al. · 0 citations
Preprint Aug 2026

Fine-Tuning VLAs with Self-Demonstrated Generative Control for Multi-Task Manipulation

This paper proposes a self-supervised method that generates online interaction rollouts from the zero-shot VLA as additional training data for finetuning and demonstrates the success of this approach across test sets probing generalization on a real ALOHA robot and a new simulation benchmark in RoboTwin.

Prachi Garg, Steve Xing, Prahit Yaugand et al. · 0 citations
Review Aug 2026

Intern-S2-Preview: Scientific Agentic Foundation Model

Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings.

Lei Bai, Jiaqi Cao, Chiyu Chen et al. · 3 citations

Constrained Multi-Objective Post-Training for Vision-Language-Action Models

A constrained multi-objective post-training method for this setting was developed and validated, and it was verified that the method’s internal constraint-enforcement mechanism behaves as intended, applying negligible pressure while the requirement is easy to satisfy and increasing sharply as it becomes difficult to me...

C. Hill, Zain Ulabedeen Farhat, Yue Wang · 0 citations
#machine learning Preprint Sep 2026

Miles v0.1: Production-Level Post-Training

Miles v0.1 is presented, a full-stack, production-ready system for frontier post-training reinforcement-learning training, which supports LoRA RL, on-policy distillation, supervised fine-tuning, and true-on-policy rollout-training alignment, and extends the same architecture to diffusion models.

R. Chen, Ma Cheng, Shi Dong et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.