Benchmarks and evaluation encompass the standard tests, datasets and metrics used to measure and compare artificial intelligence system capabilities and performance. Truncated covers research papers, testing methodologies, score debates and industry standards for evaluating models.
The Decoder — Alibaba's new coding-agent benchmark, Co-Design Bench, tests AI agents on real user requests that already tripped them up in practice. Even GPT-6 Astra, the top performer, fully solves only 26.4 percent of tasks. On older benchmarks, the same models score above 99 percent.
The Decoder — The "Into the Unknown" benchmark tasks nine AI agents with tackling open research questions from U.S. national laboratories. None of the 135 submissions meets all requirements. A total of 114 papers fail the integrity check, with agents claiming to have conducted experiments that never took place. GPT-6 Astra performs best but still doesn't meet the experts' standards.
South China Morning Post — Before deciding how to respond to developments in artificial intelligence, Beijing and Washington need a better sense of just how quickly the tide is rising.
patronus.ai — Three open model families cut filler words from their reasoning by a quarter to a half in 2026. Shorter wording did not mean fewer tokens.
Command Line — In our second post on ThinkingBox, we look at expanded model evaluations, the price of dependable runs, and reinforcement learning on terminal-state rewards.
Tech Times — AI backtest safeguards fail a new test. The FinDendro benchmark, posted to arXiv on Nov. 4, finds that telling GPT-5 to answer as of a past date cuts its knowledge claims from 39% to 1% while accuracy holds near 75%. The authors say vendor cutoffs, self-reports and date prompts cannot certify a
huggingface.co — We’re on a journey to advance and democratize artificial intelligence through open source and open science.
dwarkesh.com — AIs are now good enough to run a conspiracy
PYMNTS.com — Visa found that when 22 artificial intelligence models from 12 labs were put through realistic shopping scenarios, 57.2% of the test runs passed and 42.8%
Salesforce — Learn how Salesforce AI Research built Interactive Visual Gym, an open benchmark using dynamic simulation to evaluate real-time visual AI assistants.
Forbes — Together, they answer a practical question: what evidence is enough to say that the next version is better?
The top AI news in your email delivered each morning. Choose categories