OpenAI Targets 750 Tokens Per Second Inference Speed In July

i really hope they can pull this off. i think that, in many ways, order-of-magnitude speed increases will be more consequential than intelligence.