Synthetic traffic offers cheaper evaluation for agent search
AI-generated summary Software engineer Doug Turnbull introduced a method for evaluating AI agent search using simulated user sessions instead of LLM-generated quality scores. Published findings on November 12, 2026, reported a 70 percent cost reduction compared with LLM-as-a-judge baselines alongside improved sensitivity to search regressions.