950s vs Nvidia: «when V3 trained, it still used NVIDIA GPUs, but no longer used NVIDIA's ecosystem… As long as I redo this whole process on Huawei GPUs, it's done. I think this might be a historic mission» «Huawei 950 supernode can fully substitute for NVIDIA's GB200 and GB300 in performance and price» «four Huawei GPUs equal one NVIDIA GPU, and it's two years behind… So our chip gap with the US, I believe, will no longer exist in ecosystems, but in chips it's four-fold plus two years.»
On Huawei: «we participate deeply in Huawei's ecosystem» «Huawei gives us capacity for about 16,000 GPUs; internet giants might get over a 100K… but this may already be all the capacity Huawei has.» «So we can't count on training the next bigger model on Huawei, or training models with several hundred B activated parameters… But next year or the year after, there might be a chance.»
Liang Wenfeng believes that the comprehensive gap in AI between China and the US is 12-18 months, just like Kai-Fu Lee says and Dario hopes; and can be shrunk to 3, with surpassing in some few key areas. @scaling01 @zephyr_z9