Robert, interesting the person in this video is accurate about some things and not about other things. I heard this type of take about Bitcoin mining and of course they were wrong. Some folks mined 100s of bitcoins in a few months on ASICs in their basements.
The reality is hardware cost rose because of the war, inflation, and hype of data centers. This is temporary.
Absolutely nearly frontier models can run on higher end Macs and high end gamer machines. It’s not a guess I do it daily. My clients easily run full GLM for example. And will save millions of dollars. Quantized models of course are not the full models but for most users they are free and can run on most modern computers.
Coding models also have great utility for most users on higher end matches. It turns out not everyone is running a million context window code requirement. And I see great code out of GLM in the smallest distilled models.
See most folks don’t use go to the most expensive restaurant in town for a mid day snack.
It is a good video and the guy is interesting, but he misses the reality that most people, 99% don’t need a nuclear power station when a 9 volt battery will do.
