AI developer @teortaxesTex argues high GPU utilization gives API providers up to 90% gross margins

Realistically it's more because this isn't V3 era, production contexts are much longer. Anyway: I see 70-90 tps right now, so let's say they're doing 1.4K t/s/gpu. That's 5M tokens/hour, or ≈$4,4 at $0.87/Mt. H100 *spot prices* are now $2.4/hr. DS has at least 50% margin.

math for DeepSeek Serving Opus is at most $4/1Mt. Anthropic is not retarded They are fleecing you even on subscriptions, except maybe at 100% utilization