Featuring the man of the moment @dylan522p @shaunmmaguire in today's Training Data episode. Nobody is a more trusted industry insider to the biggest infrastructure build-out in history.
The story of how Dylan became @SemiAnalysis_ is even more awe inspiring: a young motel kid, following his curiosity about the compute industry relentlessly down rabbit holes, from Reddit forums to audiobooks to Japanese chemicals conferences...
00:00 Introduction 01:58 Motel Kid Origins 03:11 Xbox Repair Spark 04:23 Internet Forums to Semis 06:42 From Quant to Founder 09:16 Homeless Research Roadtrip 14:04 InferenceX and Benchmarking 34:35 Sparse vs Dense Models 35:08 Interconnect Shapes Architecture 35:48 CUDA Moat Is Shifting 36:46 Ecosystems and Co-Design 38:46 Cerebras Speed and Limits 42:07 ROI Debates and Hot Takes 44:20 Ten Year Tech Bets 50:48 Compute Crunch and NeoClouds
