DeepSeek open-sources DeepInfer, the inference engine behind its production services
DeepInfer's GitHub page says it powers DeepSeek's production services and supports DeepSeek-V4.1-Flash on Nvidia SM100 GPUs and Huawei Ascend 950 NPUs under Apache 2.0. A KV cache system is not included.
Why it matters: Teams serving open models get DeepSeek's own serving stack, with deterministic sampling and structured outputs, but not a complete service out of the box.