Even some of the best AI can’t beat this new benchmark called Humanity’s Last Exam

stapp · Jan 24, 2025

The benchmark, called Humanity’s Last Exam, includes thousands of crowdsourced questions touching on subjects like mathematics, humanities, and the natural sciences. To make the evaluation tougher, the questions are in multiple formats, including formats that incorporate diagrams and images.

In a preliminary study, not a single publicly available flagship AI system managed to score better than 10% on Humanity’s Last Exam.
Click to expand...

https://techcrunch.com/2025/01/23/even-some-of-the-best-ai-cant-beat-this-new-benchmark/

Log in or Sign up

Even some of the best AI can’t beat this new benchmark called Humanity’s Last Exam

stapp Global Moderator

Log in or Sign up

Even some of the best AI can’t beat this new benchmark called Humanity’s Last Exam

stapp Global Moderator

Useful Searches