Report
i14 says Sugar Glider keeps its KV cache fixed as AI context grows
At one million tokens, i14 reports up to 32x as many requests per server as its baseline.
TLDR
i14 says existing open-weight frontier models can be converted to its Sugar Glider architectures in hours, keeping memory and compute per token flat as context grows. The lab also says cache size can be chosen at deployment without retraining. The pitch: longer agent histories without an ever-growing cache.
Combined views
—
2 Sources, first seen ago
Comments