A Critical Review of LLM Agents for Automated Penetration Testing: Benchmark Realism and Evidence Grading
It is argued that automated penetration testing is best framed as a systems-engineering problem rather than a single-model race, and it distinguish engineering-tractable Type A capability gaps from planning-bottlenecked Type B failures that require base-model reasoning improvements or reinforcement-learning post-traini...