LLM Quantization: What fp8 and fp4 Do to Quality and Price
AI-generated summary OpenRouter reports that LLM quantization stores weights in fewer bits to reduce memory and hardware requirements. OpenRouter tested 1,455 endpoints across 470 models on October 20, 2026, to measure the effects of precisions like fp8 and fp4.