Soofi Releases Open 30B MoE Mamba Model for German and English
The model achieves competitive German benchmark performance and fully open-sources its pretraining pipeline.
On X, @Dorialexander pointed to a new Soofi model and called it a "competitive European model," while a linked post from @effi288 claimed Soofi S 30B-A3B is a hybrid Mamba Mixture-of-Experts release trained on 27 trillion tokens with German data upweighted. That post also claimed the model was released with training details, code and checkpoints, and that it performed strongly on English and German benchmarks.
Combined views
51.2K
6 posts, first seen 7h ago