Olmo Hybrid and long-context research at COLM 2026

A COLM 2026 attendee says they’re supporting two papers from their Allen AI days: Olmo Hybrid, a 7B hybrid model, and “Cracks in the Foundation,” on long-context recipes. A project lead says the latter tackles a puzzle from Olmo 3 training: two models trained on the same data performed nearly identically on short contexts but behaved completely differently after long-context extension.