AI-generated summary Artificial Analysis announced a partnership with GoogleDeepMind to bring MKA Benchmark to its platform. The collaboration makes the benchmark available through the Artificial Analysis platform.
AI-generated summary Artificial Analysis benchmarked both modes of Keenable Search 1.0 using the Stirrup agent harness to complete 1700 search-focused tasks. Keenable Search 1.0 achieved first and second place on the Artificial Analysis Search Index with scores of 83 for pro and 82 for realtime.
AI-generated summary @ArtificialAnlys announced an event in San Francisco on Tuesday, November 17, to discuss the quality of AI-generated images and video. The organization says the gathering will address the challenges of measuring subjective media generation models and feature a panel of industry leaders.
AI-generated summary Anthropic has launched Claude Fable 5.2 alongside Mythos 5.2 with a price cut from $10 and $50 to $8 and $40 per million input and output tokens. Anthropic reports that Fable 5.2 scored 49.1 percent on FrontierCode 2.0 and generated output up to 30 percent faster than the previous version.
AI-generated summary In AA-PersonalityBench, artificial intelligence models that rank high on sincerity tend to rank low on slop according to the data. The evaluation also shows that models ranking high on creativity tend to also rank high on humor and eloquence.
AI-generated summary Qwen-Audio-3.1-TTS-Plus leads in US English according to the analysis. HeyGen Voice performs better in UK English and also leads the overall leaderboard.
AI-generated summary DeepSeek V4.1 Flash speeds on GB300 NVL72 increased by up to 1.5x tokens per second per agent over the past month on AA-AgentPerf. The improvements stem from a newer vLLM version, new vLLM kernels, FlashInfer autotuning, and an updated setup.
AI-generated summary In AA-PersonalityBench, Qwen3.8 27B writes the longest responses of any model measured, averaging about 1,030 words per answer. Average response lengths vary widely across the models measured, ranging from 174 words for GPT-6 Sol to about 1,030 words for Qwen3.8 27B.
AI-generated summary Artificial Analysis launched VIALS-AA, a leaderboard for the Handshake AI VIALS benchmark evaluating visual reasoning in life sciences and biotech research. The evaluation uses Stirrup with code execution and image inspection tools to test models across 161 tasks spanning eight domains.
AI-generated summary Artificial Analysis released Endpoint Accuracy Index v1.1 alongside expanded coverage for GLM-5.3 Flash and Muse Spark Open. The benchmark measures how much accuracy each serverless endpoint preserves by scoring them against a self-hosted reference deployment.
AI-generated summary Artificial Analysis congratulated xdotli and the team at benchflow_ai on the launch of FrontierPhysics. Artificial Analysis stated it is excited to partner to host this evaluation soon.
AI-generated summary In AA-PersonalityBench, MiMo-V2.6-Pro concludes 34% of its responses with a question, which is the highest share recorded among all evaluated models. The measured share of responses ending with questions spans from 34% down to 0% across the various models, with several models registering 0% or nearly 0%.
AI-generated summary A one hundred dollar budget purchases forty Intelligence Index tasks using Opus 5.5 at medium reasoning effort or ten tasks at maximum effort. The same amount covers one hundred sixty six tasks with DeepSeek V4.1 Flash 1017 at maximum effort or two thousand five hundred tasks with GPT-6 Luna at medium effort.
AI-generated summary @OpenAI has launched GPT Image 2.6 Sunburst and Flare with enhanced speed running almost two times faster than GPT Image 2.5. @OpenAI reports that Sunburst Medium and Flare Medium deliver enhanced photorealism and greater editing consistency while maintaining the lead over competing labs.
AI-generated summary Artificial Analysis has launched the next version of its API Performance Benchmarking with Time per Task as the headline performance metric for serverless endpoints. Artificial Analysis says the update reflects how agentic workloads make the time required to complete a task more important than streaming speed.
AI-generated summary Artificial Analysis has launched AA-PersonalityBench to compare the personality traits and metrics of twenty different leading models. Artificial Analysis states that the top open weights models rank lower on truthfulness and higher on slop compared to the top proprietary models.
AI-generated summary Artificial Analysis has released version 2.0 of its six Artificial Analysis Capability Indexes with updated evaluations and changed category weights. Artificial Analysis states that Claude Opus 5.5 (max) leads in all six indexes followed by GPT-6 Astra (max) in several areas.
AI-generated summary @ArtificialAnlys announced that it will make the CritPt v2 grading server available to the community via its API tomorrow. @ArtificialAnlys stated that it regraded every model and observed small score increases for most models while frontier model rankings remain unchanged.
AI-generated summary According to the provided data, Kimi K3.1 Pro reportedly demonstrates the largest personality change observed compared to a direct predecessor within AA-PersonalityBench. Each model is percentile ranked from 1 to 100 on each of 30 personality traits.
AI-generated summary Artificial Analysis has rolled out market-based GPU pricing within the AA-AgentPerf datacenter system performance benchmark in collaboration with Silicon Data. Artificial Analysis says that rental price indices from Silicon Data allow the platform to report a reliable value-for-money metric that is updated daily.
The top AI news in your email delivered each morning. Choose categories