Baseten open-sources UltraFast engine for DeepSeek-V4.1-Flash
AI-generated summary Baseten has open-sourced the UltraFast inference engine optimized for NVIDIA B200 and B300 GPUs to support DeepSeek-V4.1-Flash. The Rust and CUDA engine achieves decoding speeds exceeding 2000 tokens per second using speculative decoding.