Arena.ai Open-Sources Datasets for Interaction-as-a-Judge Evaluation
AI-generated summary Arena.ai researchers, including Carnegie Mellon University PhD candidate Wayne Chi, describe Interaction-as-a-Judge for computer-use agents. The team open-sourced two agent trace datasets named ArenaWebdevPreferences and ArenaWebdevCorrectness to support future research.