Reducing High-Bandwidth Flash Latency In GPU Systems (Georgia Tech, Nvidia, Stanford)
AI-generated summary Researchers from Georgia Tech, Nvidia Research, and Stanford University published a paper about SlipStream for GPU systems. The software-hardware co-designed prefetcher aims to mitigate latency and SRAM overheads when using High-Bandwidth Flash for large language model inference.