Report
Rock Matrix open-sources EdgeRock-4B model with efficient KV cache memory
Rock Matrix released EdgeRock-4B, a ~4B parameter text-and-image model reportedly using a fixed-size KV cache to limit RAM growth.
TLDR
EdgeRock-4B reportedly keeps the last 1,024 tokens in full and saves important older details in a separate bank, keeping its attention KV cache fixed in size. Rock Matrix reports an 82.9% mean pass@1 on AIME 2024–2026, compared with 18.8% for the strongest bounded-state model it tested. The company has reportedly not detailed the model’s licensing.
Combined views
—
7 Sources, first seen ago
