Reactions from ranked influencers
4 posts
Apparently, the Moonshot kids invented time travel! They rocketed forward in time for the 20 mins Fable was available and distilled it into Kimi K3! Also those traces wrote their scaling harness, hired their engineers, wrote their RL environments and scaling code, cleaned their data, did their laundry and picked up their kids from school! I wonder what Chinese models like Seeddance 2 were distilled on since all American video models suck ass? The ByteDance boys must have borrowed the Moonshoot time machine, shot forward in time to 2050 and found the super Yud model from the future that was recursively self improving and had turned the solar system into a Matrioska Brain and was making a video model in its spare time just for Lulz.
Surprise: Kimi was distilled from Fable. https://twitter.com/typebulbit/status/2078668867052646656
@Dan_Jeffries1 No one is saying Kimi is 100% distillation, or that fast effective distillation is trivial, even when building on distillation of previous models. The point is Kimi wouldn't be where it is without it, and the whole narrative that it's honestly surpassed Fable etc. is BS.
I agree with 90% of your takes. You're usually spot on. But this one is just not real and you know it and don't seem to care. For someone who is usually ruthless in your pursuit of truth, it's pretty disappointing but we all have our blinds spots and talking points, me included.
@Dan_Jeffries1 It was available for much longer than that, and they had plenty of time to distill Opus before. Also, stick to what’s relevant.