Efficiency is the robust finding: open-weight models occupy the quality-efficiency Pareto frontier in every configuration tested, and no frontier model is Pareto-optimal; no frontier model is Pareto-optimal.
Patrick Deininger, Wolfgang Slany· Computers· 0 citations
This work benchmarks eight LLMs generating Gherkin from three requirement corpora, scoring validity, runner acceptance, judged coverage and quality, similarity to gold standard, stability, and cost, and releases the corpora, gold standard, and prototype.
Patrick Deininger, Wolfgang Slany· Applied Informatics· 0 citations
Large language models (LLMs) increasingly repair software vulnerabilities, but most evaluations judge only similarity to a developer fix or removal of the weakness, leaving no single judge trustworthy.
Patrick Deininger, Wolfgang Slany· Journal of Cybersecurity and...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.