Decisions for a penny: introducing joey-1, our fastest decision model
Baseten — A week ago we shipped mammoth-1 (27B) and elephant-1 (9B), the #1-ranked decision models. Today we’re adding joey-1, our fastest, cheapest 2B decision model.
Inference optimization encompasses the techniques and software used to reduce the computational cost and latency of running artificial intelligence models in production. Truncated covers hardware acceleration methods, quantization strategies, compiler frameworks and performance benchmarks.
Baseten — A week ago we shipped mammoth-1 (27B) and elephant-1 (9B), the #1-ranked decision models. Today we’re adding joey-1, our fastest, cheapest 2B decision model.
Baseten — Transcribe an hour of audio with Qwen3-ASR for 1/10th of a cent, with 7x higher throughput, 6.9x lower latency, and no meaningful effect on quality.
The top AI news in your email delivered each morning. Choose categories