Small models are artificial intelligence models designed for low parameter counts and efficient resource footprints to run locally on devices. Truncated covers their efficiency techniques, hardware compatibility, and deployment strategies.
AI-generated summary Liquid Foundation Models releases LFM3 as a new generation of multimodal models for text, vision, audio, omni, and decision tasks. The company states that LFM3 models are built for specialized intelligence, allowing fine-tuning on a single GPU and local deployment on various devices.
AI-generated summary Baseten released joey-1, a 2B decision model that returns answers directly as a single token and a calibrated probability score. Baseten says the model offers a P50 latency of 20 ms and costs $0.01 per million tokens, making it faster and more affordable than comparable models.
AI-generated summary Baseten has released two open-source decision models named mammoth-1 and elephant-1 on Baseten Model APIs. Baseten says mammoth-1 ranks number one on the Jev Decision Index while elephant-1 leads among 9B decision models.
AI-generated summary Baseten makes available an optimized implementation of Qwen3-ASR 1.7B for batch transcription. Baseten says the optimized stack transcribes 7x more audio per second at high concurrency compared with out-of-the-box vLLM.
The top AI news in your email delivered each morning. Choose categories