Open-source models reportedly handle 20% of their owner’s workloads
The user claims those models are about 100x cheaper than Anthropic and OpenAI.
TLDR
One user reports that their own open-source models already handle 20% of their workloads and are about 100x cheaper than Anthropic and OpenAI. Beyond their own usage, they predict open source is not far from handling 50% of all inference—the process of running AI models to generate outputs.
Combined views
13.1K
1 Source, first seen 16d ago