So don't you actually need the logits for distillation? Am I missing something here?
@yacineMTB depends how pedantic you're being about what distillation means
Like has there been some kind of breakthrough or something that I'm not aware of? Surely they're not making the logits available right? So how could they possibly be "distilling"? Or did the meaning of the word change to mean "they're using our AI models to write code"
@yacineMTB just one hot it
Many users mocked the discussion of logits in model distillation as Anthropic cope, a misused meme, or fake AI technique.
Based on 6 visible X reactions from 39 accounts; directional sample.
Ask a question below.
Published answers will appear here.
@HeinrichKuttler @yacineMTB @HeinrichKuttler, poor sad witless @yacineMTB here (not talking about his possibly imaginary children I see) was once a prominent @X stooge, i.e. one of the political hires that @elonmusk brought in after he did his ideological purge of Twitter staff. Do you think Yacine mattered
@yacineMTB For distillation you need a fractionation column and a condenser, @yacineMTB oh wait you are talking about fake AI "distillation", which is probably as meaningless as the fake-AI gibberish itself. carry on
@yacineMTB It’s just anthropic cope. It helps a little bit for general structure but they didn’t magically beat opus by distilling fable in under a month with the amount of distillation protections they have now
@yacineMTB You need. There is also a retarded version that confuses SFT on partial output (non-reasoning) with distillation.
Like has there been some kind of breakthrough or something that I'm not aware of? Surely they're not making the logits available right? So how could they possibly be "distilling"? Or did the meaning of the word change to mean "they're using our AI models to write code"
So don't you actually need the logits for distillation? Am I missing something here?
@yacineMTB depends how pedantic you're being about what distillation means
@yacineMTB just one hot it
Many users mocked the discussion of logits in model distillation as Anthropic cope, a misused meme, or fake AI technique.
Based on 6 visible X reactions from 39 accounts; directional sample.
Ask a question below.
Published answers will appear here.
