SteerDistill Quantizes LLM Agents via Steering
AI-generated summary Researchers from Tsinghua University and the University of Science and Technology of China introduced SteerDistill to address performance degradation when compressing large language model agents to low precisions. The evaluation across five benchmarks demonstrated that SteerDistill outperformed competing compression baselines while staying close to the unquantized ceiling.