AI-generated summary Baseten released an updated delta weight sync design for models like GLM-5.3 that reduces synchronization time to 15 seconds. Baseten says the new design enables throughput improvements by as much as 3.2x through optimized GPU memory utilization.
AI-generated summary Baseten released joey-1, a 2B decision model that returns answers directly as a single token and a calibrated probability score. Baseten says the model offers a P50 latency of 20 ms and costs $0.01 per million tokens, making it faster and more affordable than comparable models.
AI-generated summary Baseten has released two open-source decision models named mammoth-1 and elephant-1 on Baseten Model APIs. Baseten says mammoth-1 ranks number one on the Jev Decision Index while elephant-1 leads among 9B decision models.
AI-generated summary Baseten makes available an optimized implementation of Qwen3-ASR 1.7B for batch transcription. Baseten says the optimized stack transcribes 7x more audio per second at high concurrency compared with out-of-the-box vLLM.
The top AI news in your email delivered each morning. Choose categories