MakerMaker.AI's standard for recursive AI self-improvement

In a discussion shared by a16z, MakerMaker.AI's co-founders argue that using AI to build better AI isn't necessarily recursive self-improvement: the model itself must improve. They say gains must hold up against experiment costs and report early signs of their system getting better and cheaper over the past few months. They track experiment spending on a "bleeder board" and task an engineer with challenging their results.