Zhang previously built large-scale training systems including Meta's OPT-175B.
if true "frontier" open-source stack somehow shows up...
development tutorial processes and all...
infra, tooling, and everything in between...
compressing "intelligence-per-task-per-watt" to a 1000x smaller footprint...
suddenly treating all the above as merely a hammer for nails rather than a vision of an agi token god...
and i've not only blown tens of billies but am also on the hook for hundreds of billies more...
i'd probably want to pause for a bit too
Users support advancing efficient open-source AI stacks to improve the field and potentially undermine costly frontier spending, though some stress that software still needs far more rigorous engineering.
@suchenzang low key
if true "frontier" open-source stack somehow shows up...
development tutorial processes and all...
infra, tooling, and everything in between...
compressing "intelligence-per-task-per-watt" to a 1000x smaller footprint...
suddenly treating all the above as merely a hammer for nails rather than a vision of an agi token god...
and i've not only blown tens of billies but am also on the hook for hundreds of billies more...
i'd probably want to pause for a bit too
@TheAhmadOsman how's the tenstorrent stack doing these days?
@suchenzang 🤭🤭🤭
@suchenzang I'm trying to push the boundary with @leanprover specs for coreutils and web browsers. The specs should be largely reusable.
@suchenzang No, keep going
@suchenzang Hardware is killer but the software definitely needs a lot more love
And not “a turn on /goal “kind of love, but actual hardcore engineering (at scale…)
@suchenzang I feel like there are always ways to improve the fields, even by that point
Zhang previously built large-scale training systems including Meta's OPT-175B.
if true "frontier" open-source stack somehow shows up...
development tutorial processes and all...
infra, tooling, and everything in between...
compressing "intelligence-per-task-per-watt" to a 1000x smaller footprint...
suddenly treating all the above as merely a hammer for nails rather than a vision of an agi token god...
and i've not only blown tens of billies but am also on the hook for hundreds of billies more...
i'd probably want to pause for a bit too