Periodic reminder that not a single one of these awesome Chinese open models – NOT! ONE! – had used even a third of LLaMA 3.1 405B's pretraining compute. And still don't have some of its capabilities. The East hasn't yet caught up to Meta's level from… yep, 23 months ago.
No Digg Deeper questions have been answered for this story yet.
one of my favorite people on here are "dense Opus" truthers would explain a lot (starting with prices)
Periodic reminder that not a single one of these awesome Chinese open models – NOT! ONE! – had used even a third of LLaMA 3.1 405B's pretraining compute. And still don't have some of its capabilities. The East hasn't yet caught up to Meta's level from… yep, 23 months ago.