Loading activity…
@woosuk_k
@inferact | @vllm_project | prev: PhD @Berkeley_EECS
AI
The vLLM project estimates $38.96 per GPU-hour in revenue on AgentX at 196 P90 TPS, using DeepSeek’s off-peak API pricing.
AI
DeepSeek's README offers offline inference for DeepSeek-V4.1-Flash but lists additional systems needed for a complete service.
AI
Reflection says the release includes Mirror CLI, its open-source training harness, and collaborations with 40-plus partners.
AI
SemiAnalysis says the copper backplane expands the scale-up domain to 72, allowing each GPU to hold only some experts.
AI
SemiAnalysis also claims up to 10x better performance per dollar than GB300 NVL72 on the vLLM engine.
AI
The vLLM project says it delivers 5.3× the throughput at 150 tokens per second per user on SemiAnalysis AgentX.
AI
Compact multimodal model matches original performance at quarter the size.
