Apple Silicon and optimized OS models enable local execution.
@anshulkundaje The upcoming Mac Studio allegedly can have 768GB of RAM. I bet the Apple silicon + OS models will prove to be excellent
@vijaypande One big problem for open source is the hoarding of compute hardware by these big closed AI players. Do u know of any govt or philanthropy efforts investing in more accessible hardware infrastructure & resources? How do folks typically run open source models.
Users are optimistic about upcoming Apple silicon models like the Mac Studio with up to 768GB RAM because they expect these to deliver excellent performance amid closed AI players hoarding compute hardware.
No Digg Deeper questions have been answered for this story yet.
@anshulkundaje @vijaypande At the end of the day it could come down to having good data. That’s why they had to steal it. The compute will come to open source when efficiency improves. It may not train in 3 weeks, it may take 3 months. Still it will be good enough to compete.
@anshulkundaje @vijaypande A used RTX 3090 and see how far you can get with the ~30B param class of models :)