Report
How Indian tech teams evaluate AI model switches
Inc42 says ShareChat & Moj pair model evaluations with A/B testing to see how changes affect users.
TLDR
Inc42 describes different approaches to deciding when to switch AI models. Swiggy CTO Madhusudhan Rao advocates treating models as replaceable while investing in workflows and evaluations. ShareChat & Moj pair evaluations with A/B testing to see how changes affect users, while Shadowfax CTO Vaibhav Khandelwal uses evaluations and observability to compare model iterations on cost, speed and accuracy.
Combined views
437
2 Sources, first seen ago
