François Chollet Recommends Book Chapters on LLMs
AI researcher François Chollet points readers to his book for building language models from scratch.
François Chollet posted advice for anyone wanting to learn to build large language models. He directed readers to chapters 15 and 16 of Deep Learning with Python, noting that chapter 15 explains why dot-product attention works. The third edition of the book adds coverage of generative AI and modern frameworks and is available online. Danielle Fong reposted the recommendation. The post frames the material as suitable for a 17-year-old or any age.
If you're 17 (or any age) and you want to learn to build LLMs from scratch, read chapters 15-16 of Deep Learning with Python, available online here: In particular, chapter 15 has one of the best explanations of WHY dot-product attention works that you'll find anywhere.
Reactions
4 postsFC 
François Chollet@fcholletIf you're 17 (or any age) and you want to learn to build LLMs from scratch, read chapters 15-16 of Deep Learning with Python, available online here: In particular, chapter 15 has one of the best explanations of WHY dot-product attention works that you'll find anywhere.
- likes: 4.1K
- replies: 64
- bookmarks: 6.5K
- reposts: 420
MA mark_l_watson@mark_l_watsonThe first edition of this book was a bible for me. I just spent some time looking through the third edition, well worth the time:
- likes: 21
- replies: 0
- bookmarks: 14
- reposts: 2
MA mark_l_watson@mark_l_watsonThe first edition of this book was a bible for me. I just spent some time looking through the third edition, well worth the time:
- likes: 21
- replies: 0
- bookmarks: 14
- reposts: 2
DH Dean Harron@mistaHarronI first came across this book (prev editions) in 2023; it was also recommended by someone on X. Well, I guess it’s my turn to be that "someone on X". Please read this book (current edition) if you want to go deeper into DL. There’s even a free online version, so kind of you! 🙏
- likes: 11
- replies: 1
- bookmarks: 16
- reposts: 2