This work adapt convergent and discriminant validity from the social sciences into an approach for interrogating AI benchmarks, applying it to 56 capability and safety benchmarks across 53 models and asking analogous questions at the item level using item response theory (IRT) models.
Meera Desai, Sang T. Truong, Hanna Wallach et al.· 0 citations
This report argues that affirmative AI coverage with limits in the billions is achievable by 2030, but only with industry-wide coordination, and lays out an eight-component AI insurance stack spanning incident data collection, catastrophe modeling, standards, contract design, risk selection, pricing, monitoring, and cl...
Cristian Trout, Sanmi Koyejo, S. Romanosky et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.