Vals says AI investment has far outpaced the ability to test systems

Vals argues that investment in AI systems has far outpaced the ability to test and understand them. It advocates market-based independent evaluation as a way to build public confidence in increasingly capable AI.

The organization says its work includes an index of frontier models’ economic impact and evaluations covering social safety nets, cyber risk and mental health. It also says it regularly briefs U.S. and allied governments and national security agencies. Vals says it is committed to expanding its evaluation work and the access that enables it, while welcoming a diverse ecosystem of evaluators.