llama.cpp patch speeds up one RTX 5090 matrix multiply 4.5x
AI-generated summary A newly merged patch for llama.cpp introduces Vulkan cooperative-matrix tiles that improve matrix multiplication performance. Jeff Bolz reports that narrow tiles reduced execution time for a specific matrix multiply on an RTX 5090 from 325.49 to 72.36 microseconds.