ThinkingBox: Catching failures and training agents
AI-generated summary Command Line expanded its ThinkingBox evaluation to 18 models and published results in a paper. The post discusses model evaluations, the price of dependable runs, and reinforcement learning.