Reactions from ranked influencers
3 posts
@natolambert Wondering if the money will stop happening if progress stops. And progress is dependent of new ideas from th ecosystem. Otherwise even large closed orgs suffer from context rot
Ok, I actually agree with this. If there is no expected revenue there is not enough of an incentive to train extremely large models, so Decel. At same time, if there's only closed models, then the model makers tend to collapse to an oligopoly, which is Decel. A balancing act.
I think open-weight is basically as diffusion-accelerationist as closed (maybe slightly more on the margin), but considerably development-decelerationist due to raising ai hyper scale cost of capital. By the way, I don’t ascribe moral or ethical valence to these terms; I’m being descriptive.
also a good point tbh
I don’t know if open weight models are deaccelarationist but if they are, that’s not necessarily a bad thing!