@ArtificialAnlys

AIAI-generated summary The publisher has released Artificial Analysis Intelligence Index v5, featuring two new benchmarks and three upgrades. The publisher states that 60 percent of the Index is now based on evaluations with private test sets or held-out answers.

AIAI-generated summary Artificial Analysis has released AA-Omniscience version 1.1 to update its knowledge and reasoning benchmark with a refreshed public set and ambiguity fixes. Artificial Analysis says the update features a revised 3,000-question dataset and a newly calibrated public set on @huggingface.