@rohitrasto
interested in ml and data systems, nerdsniped by rl infra
AI
A user reports that a query took 6.84 hours with hand-tuned vLLM, versus a 15-minute “speed-of-light” estimate.
AI
