Pi Harness Matches Vendor AI Coding Agents at Half the Cost
Matei Zaharia says a simple independent harness matched vendor setups on coding tasks while using smaller prompts and cutting cost.
12133115719.4K
Harnesses make a huge difference in cost-performance. The very simple Pi harness (@badlogicgames) got the same success rate as harnesses from the LLM vendors with Opus and GPT 5.5, but at 2x less cost!
Matei ZahariaTECH#441via XStory Brief
In a post on X, Databricks co-founder Matei Zaharia said the "very simple Pi harness" built by @badlogicgames reached the same success rate as harnesses from LLM vendors when paired with Opus and GPT 5.5, but at "2x less cost." Zaharia said the apparent savings came mainly from sending smaller inputs to the model, a reminder that per-task cost can depend as much on the harness as on the model itself.
@matei_zaharia @badlogicgames Yeah youre Cache is cool but it deletes itself you Little shittard
Habibi WilliTECHvia X