SemiAnalysis says 4-hi HBM cuts inference costs
SemiAnalysis says the memory design delivers the same bandwidth with fewer dies, making scarce DRAM go further.
TLDR
SemiAnalysis makes the case for 4-hi HBM, or high-bandwidth memory, saying it provides the same bandwidth with fewer memory dies. The publisher describes it as a way to lower inference costs—the cost of running AI models—and stretch scarce DRAM supplies.
Combined views
50
1 Source, first seen 17d ago
reposts