PyTorch 2.15 tackles the 'one bad GPU' problem
AI-generated summary The 2.15 release of PyTorch introduces a rewritten backend for Nvidia's Collective Communications Library to improve fault diagnosis and recovery when multiple GPUs work together. The updated software includes a flight recorder to capture operations after failures occur, along with support for Nvidia's next-generation Blackwell GPUs and parallel processing improvements for Apple gear.