Reaction
GPU rental prices climb as average AI token prices fall
The “rack spread” compares GPU rental and token prices; a16z analysts cite competition and lab price cuts for cheaper tokens.
TLDR
Since mid-July, a16z puts B300 GPU rentals up 106%, B200 rentals up 66% and H100 rentals up 17%, while average token prices fell 58%. Its analysts borrow “rack spread” from oil refining’s “crack spread” to examine the gap between input and output prices. They caution that the comparison is not a company’s net margin.
Combined views
10.3K
2 Sources, first seen ago
