Hugging Face co-founder Julien Chaumond says modern data infrastructure reverses traditional design by placing compute next to storage

@julien_c next: put your storage on hf buckets

old: put storage next to your compute new: put compute next to your storage

@julien_c La data gravity rend ça presque inévitable : quand un checkpoint pèse des To, déplacer les poids coûte plus cher que le calcul. Rapprocher le compute du stockage, c'est arrêter de payer le réseau à chaque itération.

@julien_c Storage becomes your compute

@julien_c true for inference-heavy. training still needs shared optimizer state on the wire. when every gradient step touches every shard, the bottleneck moves from compute-to-storage to storage-to-storage. fabric still wins for training.