The economics of selling AI inference on its own

Bernhardsson expects the inference market to split into specialized segments, including low-latency services, fine-tuning and post-training. He argues that standalone inference has no switching costs, so providers need products such as sandboxes and agent tools to keep customers. He sees Modal reaching 40% to 60% gross margins long term, below the 90%-plus software margins he says were once common.