‘How to Scale Your Model’ roofline chapter gets an interactive edition
The creator says the Astra-built edition includes NVIDIA GPUs and separates high-bandwidth memory (HBM) and network analysis.
TLDR
The creator says they used Astra to turn the roofline chapter of “How to Scale Your Model” into an interactive edition, with NVIDIA GPUs and separate HBM and network analysis. The linked page explains “roofline” constraints as limits on computation set by math speed, data-transfer bandwidth and total memory capacity.
Combined views
—
1 Source, first seen ago
