Neil Movva Explains AI Inference Layers From Chips To Power · Digg

/AI

Neil Movva Explains AI Inference Layers From Chips To Power

Combined views

231.1K

2 posts, first seen 9h ago

804 likes comments

Neil Movva Explains AI Inference Layers From Chips To Power

Reactions

2 posts

PO
Patrick OShaughnessy@patrick_oshag 9 hrs ago
Neil Movva (@neilmovva) started his career at Nvidia, working on GPUs and kernels, and has an unusually deep understanding of inference, from software to chips to power. We spend a lot of time on each of those layers, how they connect, and where the important tradeoffs are.…
- likes: 721
- replies: 25
- bookmarks: 1.1K
- reposts: 65
PO
Patrick OShaughnessy@patrick_oshag 7 hrs ago
Neil on why AI spending today is different from the dot-com bubble: "A lot of the investment in networking equipment historically was speculative. We anticipated this future demand for users that never came. What's interesting about token consumption is that it's no longer…
- likes: 83
- replies: 8
- bookmarks: 59
- reposts: 15

Combined views

231.1K

2 posts, first seen 9h ago

804 likes

33

1.2K saves

80 reposts

33 comments

1.2K saves

80 reposts

Reactions

23 posts

PO
Patrick OShaughnessy@patrick_oshag 9 hrs ago
Neil Movva (@neilmovva) started his career at Nvidia, working on GPUs and kernels, and has an unusually deep understanding of inference, from software to chips to power. We spend a lot of time on each of those layers, how they connect, and where the important tradeoffs are.…
- likes: 721
- replies: 25
- bookmarks: 1.1K
- reposts: 65
1. NO
  NotaDEV@leononrails 9 hrs ago
  @patrick_oshag @neilmovva an nvidia guy with a contrarian view on nvidia is the only nvidia take worth 70 minutes
  - likes: 5
  - replies: 0
  - bookmarks: 0
  - reposts: 0
2. PO
  Patrick OShaughnessy@patrick_oshag 9 hrs ago
  @neilmovva Youtube: https://www.youtube.com/watch?v=uyzqxIoiobU Spotify: https://open.spotify.com/episode/7GZ9BixZYi6SIxvVRbYbNf?si=hnz48pxDT3Oy3jD_l2RZ6Q Apple: https://podcasts.apple.com/us/podcast/neil-movva-making-ai-10x-cheaper/id1154105909?i=1000785705137
  - likes: 14
  - replies: 1
  - bookmarks: 6
  - reposts: 5
3. MI
  MimiCO@MikoMimie 9 hrs ago
  @patrick_oshag @neilmovva "No bad chips, only bad pricing" has a live test case this week.Jane street ran an etched rack in prod, then led the $700m round at $21b. First customer to lead investor in 26 days.
  - likes: 0
  - replies: 0
  - bookmarks: 0
  - reposts: 0
4. JC
  J.P. Challenger@PowerInVOX 9 hrs ago
  @patrick_oshag @neilmovva Making tokens cheap isn't just engineering, it's democratizing AI! When infrastructure becomes accessible, innovation reaches everyone. Passion, technology and society moving forward together.
  - likes: 0
  - replies: 0
  - bookmarks: 0
  - reposts: 0
5. DJ
  Daniel Joshua Rubin@DanJoshuaRubin 9 hrs ago
  @patrick_oshag @neilmovva This is exactly what @nebiusaistudio has been executing - Arkady Volozh has said countless times Nebius helps companies use AI to build things “10 x cheaper, 10x faster, 10x more”… would love to see him with his much longer track record come on the show…
  - likes: 0
  - replies: 0
  - bookmarks: 0
  - reposts: 0