A proposal to distill unreleased AI models on users’ own evaluations
A user argues frontier AI labs should offer this as a product, claiming it would create switching costs and provide more than 5× compute efficiency.
TLDR
A post proposes that frontier AI labs let users distill one of their large, unreleased models on the user’s own evaluation. The author predicts two benefits: switching costs and more than 5× compute efficiency.
A proposal to distill unreleased AI models on users’ own evaluations
A user argues frontier AI labs should offer this as a product, claiming it would create switching costs and provide more than 5× compute efficiency.
TLDR
A post proposes that frontier AI labs let users distill one of their large, unreleased models on the user’s own evaluation. The author predicts two benefits: switching costs and more than 5× compute efficiency.