Yuchen Jin, who builds AI systems and products at Databricks, reports worsening GPU shortages as H100 prices exceed three-year-old levels and on-demand availability disappears due to major labs' multi-year contracts
Developers increasingly rely on older A100 GPUs amid constraints.
#251Julien Chaumond@JULIEN_Cthe gpu crunch is real
Yuchen Jin@Yuchenj_UWGPU shortage is worse than ever. H100s cost more today than they did 3 years ago, and you cannot get them on-demand. The big AI labs have locked up most of the supply for years. I’m worried university researchers and individual developers simply won’t be able to get GPUs.
#687Bojan Tunguz@TUNGUZSo much for technological obsolescence of GPUs.
Yuchen Jin@Yuchenj_UWGPU shortage is worse than ever. H100s cost more today than they did 3 years ago, and you cannot get them on-demand. The big AI labs have locked up most of the supply for years. I’m worried university researchers and individual developers simply won’t be able to get GPUs.
#1245Alex Volkov@ALTRYNE@mattshumer_ forgot to paste this:
Alex Volkov@altryneH100 is more expensive now than it was when released, ,is a 3 y/o hardware, and you can't find any available on demand! Inference is everything. The stock market has no idea
#1245Alex Volkov@ALTRYNEH100 is more expensive now than it was when released, ,is a 3 y/o hardware, and you can't find any available on demand!
Inference is everything.
The stock market has no idea
Yuchen Jin@Yuchenj_UWGPU shortage is worse than ever. H100s cost more today than they did 3 years ago, and you cannot get them on-demand. The big AI labs have locked up most of the supply for years. I’m worried university researchers and individual developers simply won’t be able to get GPUs.
#1674xlr8harder@XLR8HARDERcurrently using A100s like an animal
Yuchen Jin@Yuchenj_UWGPU shortage is worse than ever. H100s cost more today than they did 3 years ago, and you cannot get them on-demand. The big AI labs have locked up most of the supply for years. I’m worried university researchers and individual developers simply won’t be able to get GPUs.