Ramp launches public LLM router to cut infrastructure costs

you could hire an olympic sprinter to walk your dog. it'd go great. it'd also be insane that's basically how most companies run ai right now. a frontier model on every task, including the ones a model a fraction of the price would nail. we built ramp router to fix this for… Show more

The year is 2028. Chinese open models have commoditized the frontier labs to dust. Ramp is the most valuable AI company in the world. All is right. https://twitter.com/vral/status/2079267940021477864

ramp web services 🤔 more seriously, you could hire an olympic sprinter to walk your dog. it'd go great. it'd also be overkill. but that's basically how most companies run ai right now. a frontier model on every task, including the ones a model a fraction of the price would… Show more

Huge launch from @tryramp. Different steps in an agent workflow can use different models. This can help reduce costs significantly without sacrificing performance. Model routing will become a core part of the stack. Now available in one OpenAI-compatible endpoint.… Show more

AI routing is itself an optimization problem. The router has to pick the cheapest model that can still do the job with the quality and latency required. Ramp Router is attacking that increasingly difficult problem: The best model choice from yesterday quickly stops working… Show more

this feels even *more* strategic than aws was for amazon https://twitter.com/eglyman/status/2079272960037146922