DeepSeek open-sources DeepInfer inference framework

DeepSeek also open-sourced deepseek-recipe, a separate token encoding and decoding component it says is intended to bring the official DeepSeek API's processing behavior to community deployments. Its README describes Rust libraries and Python bindings for converting requests, rendering prompts, encoding tokens and converting model output into responses. The caller must provide model inference, tool execution and HTTP transport.

What a complete service still needs

The DeepInfer README says this release provides offline inference, not all the systems needed for a complete inference service. It lists a KV cache system, VE/prefill/decode disaggregation and load balancing across prefill and decode replicas as required but not included. The README adds that most of the engine functionality needed for disaggregation is already implemented.