DeepSeek V4.1 Flash speeds on GB300 NVL72 have increased by up to 1.5x tok/s per agent over the past month on AA-AgentP…
AI-generated summary DeepSeek V4.1 Flash speeds on GB300 NVL72 increased by up to 1.5x tokens per second per agent over the past month on AA-AgentPerf. The improvements stem from a newer vLLM version, new vLLM kernels, FlashInfer autotuning, and an updated setup.