a16z announces investment in Preference Model

a16z announced its investment in Preference Model on October 7. It says the company builds reinforcement-learning environments for AI research and machine-learning engineering, with tools that identify model weaknesses, generate tasks targeting those gaps and test environments against agents trying to break them. a16z said Preference Model was open-sourcing Karotte that week and described the framework as hardened through more than a million evaluation runs and red-teaming.