GDN-2-3B reportedly follows Nemotron-3 Nano’s architecture, replacing Mamba-2 layers with GDN-2
A post quotes a description of GDN-2-3B as a hybrid latent mixture-of-experts model and a release candidate.
TLDR
A September 26, 2026 post quotes text describing the hybrid GDN-2-3B latent mixture-of-experts model as a “near-term release candidate.” The quoted description says it follows the Nemotron-3 Nano architecture but replaces the Mamba-2 layers with GDN-2.
Combined views
1.4K
1 Source, first seen 57m ago
GDN-2-3B reportedly follows Nemotron-3 Nano’s architecture, replacing Mamba-2 layers with GDN-2
A post quotes a description of GDN-2-3B as a hybrid latent mixture-of-experts model and a release candidate.
TLDR
A September 26, 2026 post quotes text describing the hybrid GDN-2-3B latent mixture-of-experts model as a “near-term release candidate.” The quoted description says it follows the Nemotron-3 Nano architecture but replaces the Mamba-2 layers with GDN-2.