Combined views
161
2 posts, first seen 2h ago
6 likes
161
2 posts, first seen 2h ago
Guardrails removed spam, off-topic, unclear, or duplicate replies.
Ask a question below.
Published answers will appear here.
@teortaxesTex @she_llac yes, i specifically recall lots of post-hoc tinkering with upcycling & toy kldiv distillations on a budget during the Mixtral era
@kalomaze @she_llac weren't you the one who already experimented with MoEs then
Guardrails removed spam, off-topic, unclear, or duplicate replies.
Ask a question below.
Published answers will appear here.