T2J-BENCH is introduced, a benchmark of 63 whole-repository PyTorch-to-JAX migration tasks spanning 18 model families across both training and serving, and TWINHARNESS, a reference-grounded agent harness that turns the agent's executable PyTorch source into legitimate self-verification feedback.
Tao Feng, Jie-Feng Chen, Lin-Xin Song et al.· 0 citations
Evaluation has been central to advances in AI, and it is equally critical to autonomous discovery. Yet scaling autonomous discovery to real-world engineering challenges faces a fundamental bottleneck: the cost of evaluating progress. In real settings, a single true evaluation, such as a full benchmark or serving trace,...
Shubham Agarwal, Akshat Gupta, M. Heddes et al.· 0 citations
VEPA is introduced, a framework for the verified evolution of formal agent guardrails that represents the guardrail as a formal policy of executable symbolic rules over typed agent events and consistently outperforms baselines while expanding the scope of deterministic formal-policy enforcement.
Duy Nguyen, Lesly Miculicich, Bhavana Dalvi et al.· 0 citations
It is shown that explicit idea-level allocation makes semantic coverage directly controllable, and that broader coverage becomes increasingly valuable when competitive research directions are sparse among many plausible alternatives.
Environment Harness is proposed, a programmable layer of plug-in components that wraps a static environment to reshape its behavior without modifying the underlying logic, enabling continuous, targeted co-evolution of the policy and its environment.
Chengsong Huang, Zifeng Wang, Ru-Jun Han et al.· 16 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.