TrueFoundry's AI routing was 69% cheaper than Opus alone in a test, a user reports

A user working with TrueFoundry's Auto Routing argues that simpler AI requests don't need the strongest model. They describe a system that classifies requests as simple, medium or complex and sends each to a model assigned to that tier. Classification can use a free heuristic classifier that scores prompt signals or an LLM classifier for more nuanced judgments. The user cites a TrueFoundry experiment on 550 deterministically graded academic prompts: routing among Claude Haiku, Sonnet and Opus was reportedly 69% cheaper while retaining 98% of the quality of sending every request to Opus.