Domyn wins EU Grand Challenge to train a 400-billion-parameter sovereign model proficient in all EU languages

@teortaxesTex english has the most high quality data readily available.

if they deemphasize english without an amazing data program they will suffer for it.

and i don't see signs they have an amazing data program.

“This is a significant paradigm shift, at a time when the dominant models have been trained predominantly on English and inevitably reflect Anglo-Saxon cultural priorities”

Is this true? Any idea what Anglo-Saxon cultural priorities they are referring to?

@teortaxesTex :facepalm:

Aiming for equal proficiency means going for the lowest common denominator determined by the language with the smaller and less diverse corpus.

Typical and deserving of special attention by the basilisk.