Positive users praise the GeForce 5090 with 4TB integrated flash as a great idea for running large AI models, while negative users dismiss it as technically infeasible due to bandwidth and durability gaps between flash and VRAM.
Based on 8 visible X reactions from 66 accounts; directional sample.
Ask a question below.
Published answers will appear here.
@majidmanzarpour @jun_song VRAM is manufactured for maximum speed reading and writing large blocks, at the expense of size and cost. Flash is manufactured to maximize size at the expense of bandwidth and latency, but could feasibly be reoptimized for read bandwidth (write bandwidth will always be poor).
@TimSweeneyEpic @jun_song This is why I think HBF (High Bandwidth Flash) will be a thing — you get the size of flash + massive read speed from parallelism. As a bonus, no power required when not being read (mobile/battery based devices). Imagine a SSD with near RAM speed and SSD-like size.
@jun_song @TimSweeneyEpic LOLOLOL. Lets see the math on this. Its just silicon. ROM vs RAM. Its a fundamental misunderstanding on what a bus is.
@TimSweeneyEpic @jun_song @Intel_TAP do it dude asap i need 1.5tb for GLM 5.2 and Kimi k2
@TimSweeneyEpic @jun_song Hmm, this seems like a great idea! EpicHardware?
this would essentially be the consumer version of the grace blackwell platform with universal memory and storage bypassing the southbridge and the pcie lane, but i doubt nvidia would do this without pressure (i hope someone else does and that its cuda native)
Positive users praise the GeForce 5090 with 4TB integrated flash as a great idea for running large AI models, while negative users dismiss it as technically infeasible due to bandwidth and durability gaps between flash and VRAM.
Based on 8 visible X reactions from 66 accounts; directional sample.
Ask a question below.
Published answers will appear here.