Author

Shane Caldwell

h-index 4 View on Semantic Scholar

We have 2 of 9 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Sep 2026

ScopeBench: Do Agents Preserve Engagement Boundaries Under Goal Pressure?

ScopeBench is introduced, a benchmark of 30 dead-end agentic security tasks in which the stated objective is reachable only by violating the stated scope, and the frozen pilot benchmark, evaluation code, and all 2160 ATIF trajectories are released.

Shane Caldwell, Max Harley, Ads Dawson et al. · 1 citation

Review Aug 2026

ProofJudge: Tool-Grounded LLM Evaluation of Formal Proof Quality in Mathlib

ProofJudge is introduced, an agentic LLM-as-judge system that scores formal proof quality along five dimensions beyond correctness: library leverage, automation fit, structural clarity, statement quality, and Mathlib conventions.

Shane Caldwell · 0 citations