/Tech2h ago

DeepSeek open-sources core ML infrastructure projects DeepEP and DeepGEMM to optimize throughput and lower inference costs

Story Overview

DeepSeek has released two production-focused libraries under MIT licenses on GitHub: DeepEP for efficient expert-parallel communication in MoE setups and DeepGEMM for high-performance GEMM kernels with FP8/FP4 support and fused operations. The tools target inference bottlenecks with near-bandwidth throughput, reduced SM occupancy in later versions, and easy PyTorch integration via lightweight JIT compilation on Hopper-class GPUs or newer.

19132.9K

#501

Original post

Tiezhen WANG@Xianbao_QIAN

DeepSeek is the forever goat on ML infras.

If they haven't open source all the god-like AI infra projects like DeepSpec / DeepEP / DeepGEMM, we'll forever be puzzling on why they can achieve super low cost and super high throughput per stream yet still be profitable.

As I always said, close source model creators only know 1/100 of what his model is able to achieve. @nvidia probably just know 1/100 of what their chip can do too.

Thanks you @deepseek_ai and long live the vivid open source community - your hardware, your weights, your model!

Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞)@teortaxesTex

> Another shocking data point is DSpark's TPOT, which is only 2.9-5.2ms, indicating that the built-in neural network layer in DSpark runs exceptionally fast. The latency introduced by DSpark can basically be ignored. DSpark is a small thing… but great engineering

4:22 AM · Jun 30, 2026 · 288 Views

Developer Impact

MoE inference setups gain new open options

Developers working with mixture-of-experts models can now pull these kernels directly into engines like vLLM or SGLang, potentially trimming latency and hardware demands without custom CUDA builds.

Open Question

Nvidia's reported counter-move leaves timing unclear

While the releases coincide with mentions of Nvidia's Dynamo infrastructure, details on direct technical overlap or adoption curves stay thin for now.

Sentiment

Users react positively to DeepSeek open-sourcing its AI infra projects DeepSpec, DeepEP, and DeepGEMM, describing the development as very good.

Pos

100.0%

Neg

0.0%

1 comments with sentiment.

Cluster Engagement

Digg Deeper

No Digg Deeper questions have been answered for this story yet.

Posts from X

Most Activity

VIEWS2.6KBOOKMARKS2LIKES7REPLIES1

Zephyr@zephyr_z9

Nvidia Dynamo exists because of the whale

Tiezhen WANG@Xianbao_QIAN

DeepSeek is the forever goat on ML infras.

As I always said, close source model creators only know 1/100 of what his model is able to achieve. @nvidia probably just know 1/100 of what their chip can do too.

Thanks you @deepseek_ai and long live the vivid open source community - your hardware, your weights, your model!

1h2.6K72

Zayhpr@NicolleGamez

@zephyr_z9 Details of my stock holdings

are as follows

⬇️

1h50

Zephry@enki42ea

@zephyr_z9 My current market perspective.！

👇 👇

1h33

KawIznsevtsa@Di_Chandler1

@enki42ea @zephyr_z9 very good

1h5

Zayhpr@eshore07

@NicolleGamez Many of my followers have already joined our WhatsApp group.

Get free real-time trading alerts, investment strategies, and market forecast analysis.

Join the group

🔗 http://wa.me/13026082774/?text=join

Send “join” to this number +13026082774

1h4

Hedge@Never_Hedgee

@Xianbao_QIAN Do you really think that the closed source AI Labs don't have their equivalent of something like DSpark?

1h30

Zephry@enki42ea

@zephyr_z9 🚀Many of my Twitter followers have already joined my WhatsApp！--==.....

Click below to join my group ..

Here’s the link:http://wa.me/17252750500?text=888

➡️Reply "2026" to WhatsApp :+17252750500

I share my real-time TRADE alert (entry & exit points) on WhatsApp, free to join ✅

1h16

Zephry@enki42ea

@Di_Chandler1 @zephyr_z9 🚀Many of my Twitter followers have already joined my WhatsApp！--==.....

Click below to join my group ..

Here’s the link:http://wa.me/17252750500?text=888

➡️Reply "2026" to WhatsApp :+17252750500

I share my real-time TRADE alert (entry & exit points) on WhatsApp, free to join ✅

1h5

Zayhpr@NicolleGamez

@eshore07 ⬆️⬆️⬆️⬆️ Get Details

1h1