Inkling 2 Small Runs on vLLM From Day Zero
AI-generated summary Thinking Machines announced that its new Inkling 2 Small model has day-zero vLLM support and includes a native DSpark speculator. The 594B-parameter mixture-of-experts model accepts text and image inputs with context lengths up to 1M tokens and fits on a single GB200 or GB300 node.