Reactions from ranked influencers
4 posts
All critical & indispensable *open-source* frameworks that many of us rely on today (often without noticing, it seems!) E.g. PyTorch/JAX is used by all the frontier labs -- imagine the slow-down & fracturing of progress if each had to develop their own proprietary framework?
@hosseeb @deanwball Soooo, releasing Linux was dumping? Apache, MySQL, PHP? HTTP, TCP/IP, OpenSSL, OpenSSH? Libjpeg, VLC? The open source software stack of the mobile communication network? Signal? PyTorch? Llama?
Man, it's baffling to me that people either forget too quickly about the impact of open source or are just too lazy to pick up a book and read about it. Having worked on open-source tools all these years, it's really sad to see such ignorance. Thanks for reminding people, Yann.
@hosseeb @deanwball Soooo, releasing Linux was dumping? Apache, MySQL, PHP? HTTP, TCP/IP, OpenSSL, OpenSSH? Libjpeg, VLC? The open source software stack of the mobile communication network? Signal? PyTorch? Llama?
This. The current state of frontier models is built on millions and millions of dollars of academic grants, and the output of frontier labs from the period where publishing was standard in industry. Open science benefits everyone, and it's not incompatible with entrepreneurship.
@hosseeb @deanwball Soooo, releasing Linux was dumping? Apache, MySQL, PHP? HTTP, TCP/IP, OpenSSL, OpenSSH? Libjpeg, VLC? The open source software stack of the mobile communication network? Signal? PyTorch? Llama?
@ylecun @hosseeb @deanwball Did you not read the post you're responding to? "The amount of capex required for frontier-level models is an order of magnitude higher than normal software" Did any of the systems you list cost a hundred million dollars or more to write?