1d ago

ByteDance Develops Custom CPUs for AI Data Centers to Ease Supply Constraints

0
Original post

Reuter: ByteDance is building its own AI data-center CPUs because running agents at TikTok scale now depends on scarce server processors, not only Nvidia GPUs. inspired by Groq's "language processing units," they are testing both Arm and RISC-V, which lets it compare a mature commercial design against a more controllable open instruction set before mass production. The market is seeing a 10%-35% quarterly CPU price increases and long supply delays, hence making an in-house silicon is now cost and supply-chain move, not just a prestige project. So ByteDance wants to both reduce dependence on restricted foreign AI hardware and make inference cheaper per query. The deeper shift is that AI agents is now turning CPUs into strategic chips. A gentic inference stresses CPUs much more because one user request can trigger many smaller steps: retrieve files, call a tool, query a database, run a model, check the answer, call another model, send data across servers, and manage memory. However, ByteDance does not seem to have in-house chip design teams and is reportedly relying on several external partners, who are also expected to handle the actual silicon manufacturing. --- reuters .com/world/china/bytedance-developing-custom-cpu-chips-support-ai-rollout-sources-say-2026-05-28/

1:54 AM · May 30, 2026 View on X
Reposted by