Announcement
Cerebras’ approach to deploying multi-trillion-parameter models at scale
Cerebras’ CTO describes fitting the full model into on-chip memory and mapping it across multiple chips.
TLDR
Cerebras’ CTO says his breakdown covers how the company fits a full model into on-chip memory, maps it across multiple chips and handles a high number of concurrent requests. A colleague who filmed it describes the focus as the math that turns model parameters into inference.
Combined views
—
5 Sources, first seen ago
