Off-chip bandwidth has always been the weak point of wafer-scale. The WSE-3 has staggering on-wafer SRAM bandwidth, but everything slows down the moment data has to leave the wafer. That mattered because the wafer only holds 44GB of SRAM, so big models get spread across many…
CS-4 makes progress here. Off-wafer I/O doubles from 1.2Tb/s to 2.4Tb/s, since the wafer's parallel I/O scales with the 2x clock bump. On top of that sits a new Wafer I/O module: a field-upgradeable FPGA NIC that converts Cerebras's proprietary I/O to standard ethernet. That…
Off-chip bandwidth has always been the weak point of wafer-scale. The WSE-3 has staggering on-wafer SRAM bandwidth, but everything slows down the moment data has to leave the wafer. That mattered because the wafer only holds 44GB of SRAM, so big models get spread across many…
CS-4 makes progress here. Off-wafer I/O doubles from 1.2Tb/s to 2.4Tb/s, since the wafer's parallel I/O scales with the 2x clock bump. On top of that sits a new Wafer I/O module: a field-upgradeable FPGA NIC that converts Cerebras's proprietary I/O to standard ethernet. That…