Who should grade AI? a16z describes the case for independent testing
Vals AI CEO Rayan Krishnan argues for continuously evolving evaluations as public benchmarks saturate and models get better at optimizing for tests, a16z says.
Posts from X
A1 
a16z@a16zVals AI co-founder and CEO Rayan Krishnan with a16z's Ben Horowitz and Jennifer Li on grading AI, what it costs, and who gets to make the rules: Every big industry eventually grows an independent testing layer. AI has credit ratings to learn from and Enron to avoid. Model…
- likes: 134
- replies: 20
- bookmarks: 48
- reposts: 14
A1 a16z@a16zVals AI CEO Rayan Krishnan on how they score a model's ability to build its own successor: "One benchmark we released recently is our Recursive Self-Improvement Index. It's a topic which a lot of the big labs have been talking about and starting to report on in their model…
- likes: 75
- replies: 12
- bookmarks: 15
- reposts: 5