Reactions from ranked influencers
2 posts
> Mythos 800B active I think Wenfeng didn't literally mean it, but if he does… lmao
Looks like Mythos is 800B Active params (the teacher model) not Fable 5/Mythos 5 https://twitter.com/teortaxesTex/status/2080143652207100339
some back of napkin calcs on the 800B active, if the model shared something similar to the rumored gpt4 architecture instead of the dsv3 sparse architecture, then that would put it around 10T-12T total params. no idea if its true or not but wenfeng is usually very well informed and the math checks out