PyTorch 2.14 Release Blog Published
Research engineer Stas Bekman flags NCCL2 and fault tolerance updates in the new release.
TLDR
Stas Bekman posted that PyTorch 2.14 is out and linked the official release blog. The blog states that reductions received a dedicated five-part rewrite covering full reductions, inner-dimension reductions, strided and batched outer reductions, small-dimension and narrow kernels, and the argmax and argmin split-K paths. Bekman noted the NCCL2 and fault tolerance sections as worth exploring and thanked the PyTorch team for framework improvements.
Combined views
2.9K
1 Source, first seen 27d ago