Amazon and UMass paper finds LLM critics can hurt AutoML search
AI-generated summary Amazon and University of Massachusetts researchers report that integrating an LLM critic into an AutoML search loop provides limited potential upside of about 0.005 AUC. The study shows that a Llama-3.1-8B critic performed worse than the baseline without a critic on seven out of eight datasets tested.