Model Comparisons · Mon 9 Nov

AIAI-generated summary Researchers at the University of the Pacific School of Pharmacy published a study in Scientific Reports comparing the accuracy of five large language models on 227 infectious disease examination questions. ChatGPT-4o-mini achieved the highest accuracy at 91.2 percent, while the evaluation showed that model performance declined on questions containing images.

ChatGPT Benchmarks Model Comparisons Healthcare

AIAI-generated summary In AA-PersonalityBench, artificial intelligence models that rank high on sincerity tend to rank low on slop according to the data. The evaluation also shows that models ranking high on creativity tend to also rank high on humor and eloquence.

Benchmarks Model Comparisons

AIAI-generated summary Google model krypton takes double the time and writes double the code on the same prompt compared to other versions. The user describes krypton as the most hardworking Google model they have ever tested from a first checkpoint.

Google Gemini Test-Time Compute Model Comparisons