Characterizing CUDA Locality Domains on Blackwell GPUs
AI-generated summary A report evaluating the Locality Domain feature introduced in CUDA 13.4 examines multi-die scaling, data placement, and cross-die communication on NVIDIA Blackwell GPUs. The study demonstrates that die-aware adaptations achieve significant speedups for tools including NCCL 2.32.3, nvbandwidth, and DeepGEMM, while also identifying memory allocation overheads.