We've tested new OSS models the moment they're released for a while at Lindy. Inference is our #1 cost by a lot (more than payroll) — cutting it by 2-5x would be transformative. Last year, OSS models were "not even close." 3 mos ago, "almost there." Came close to making Kimi K2.5 our default. I think we are right now crossing the line to "at the frontier, for most use cases." GLM-5.1 in particular is incredible and will likely be our default soon. Surprised by this development — OSS caught up.
Most Activity
"LLM cost until yesterday was our biggest cost as a company, more than payroll, which is kind of insane when you think about it."
@Altimor, founder of @getlindy, explains why they switched from Anthropic to DeepSeek:
"For 12 months, every time we tried an open source model we were like, 'Yep, it's bullshit.' But we kept saying, 'Let's not be disillusioned, we can feel that gap closing.'"
"Four months ago I had a tweet saying, 'Those models are so bad.' Now, 'It's closed the gap and it's working. It's incredible.'"
"You don't need God to write your email, at some point you tap out of intelligence, and if you can get those lower tiers for a tenth of the price, it would be foolish not to."
Pulled the trigger today and switched 100% of Lindy traffic to DeepSeek v4, churning from Anthropic models. Saves us millions of $ and we're actually seeing an *increase* in performance on many core use cases. Transformative for the business.
