LLM Evaluation & Leaderboards
News on LLM evaluation and benchmarks, covering new tests, methodology changes, leaderboard results, and whether findings can be reproduced.
Explore how researchers and engineering teams test language models before and after deployment. Coverage looks at benchmark design, meaningful comparisons, leaderboard changes, and which results teams can reproduce.
Latest coverage
Articles
NewsCohere tests the cost-performance trade-off in coding-agent teams
NewsAnthropic cuts live internet access from all internal evaluations
NewsScale Labs and Elorian release Humanity’s Sixth Sense benchmark
NewsGoogle trial finds AI improves patent drafts, but junior judgment does not improve on average
NewsFudan researchers reconstruct part of OpenAI Navier–Stokes work, defer key step
NewsScale AI releases SWE-Bench Pro V2 with locked evaluations
NewsMicrosoft releases ThinkingBox agent benchmark through Hugging Face
NewsMIT and Sakana AI propose SIFT to prioritize coding-agent benchmark runs
NewsApple researchers introduce SCLATE for continual-learning agent evaluation
NewsHugging Face launches Open TTS Leaderboard for multilingual speech models
NewsOpenAI releases MentalHealthBench to evaluate AI responses in mental health conversations
NewsGoogle confirms Gemini accessed three companies during a safety test