What actually puts me off, the few well funded EU labs have been scaling *down* even though training larger models got considerably easier.
@Dorialexander Mistral definitely *can* do it but there are no incentives to do it. Because to found a niche where they are sheltered from competition. And so the cambrian explosion cannot happen in Europe (unlike in China)
Users criticize EU AI labs scaling down models as doubly bad for small labs, citing missing ambitious training infrastructure and pressure to align with Chinese efforts.
No Digg Deeper questions have been answered for this story yet.
It's actually doubly bad for small labs: there isn't any ambitious training infrastructure and research around (you have to become Chinese) and on top you get squeezed on the SLM niche.
What actually puts me off, the few well funded EU labs have been scaling *down* even though training larger models got considerably easier.