Negative users mocked Meta's half-size custom AMD MI455X chip for RecSys workloads as absurd overengineering that fails at inference or training while inflating team value.
Based on 3 visible X reactions from 3 accounts; directional sample.
Ask a question below.
Published answers will appear here.
Another example of Meta's overengineering obsession is GB200 NVL72 Ariel, which caused massive infrastructure issues with its cross-rack NVLink ACC cables due to signal integrity problems, as Meta was obsessed with having the Grace CPU at a 1:1 ratio with the GPU. This decision was not the correct path, as shown by Meta going back to a standard Oberon design for GB300 and VR200 NVL72. 5/7🧵
This is yet another instance of the recsys infrastructure strategy team at Meta wanting to look like they “add value” by doing weird micro-optimizations that hurt other important divisions at Meta. 4/7🧵
@SemiAnalysis_ Meta designed a custom chip that cant do either inference or training? ahahahahAHAHAHAH
Compared to a normal MI455X package, it will use six HBM4 8i stacks instead of 12 HBM4 12Hi stacks. The reasoning is that Meta’s recsys infrastructure strategy wanted to have a CPU compute-to-GPU compute ratio tuned for recsys and to optimize memory $/BW. 2/7🧵
ALERT🚨🚨: META's CUSTOM AMD MI400-series chip will be half the size of a normal MI455X chip. It is "optimized" for recsys workloads and $/Memory Bandwidth. It will use ~144GB of HBM instead of 432GB. We break it down below👇️ 1/7🧵
Negative users mocked Meta's half-size custom AMD MI455X chip for RecSys workloads as absurd overengineering that fails at inference or training while inflating team value.
Based on 3 visible X reactions from 3 accounts; directional sample.
Ask a question below.
Published answers will appear here.