
When will humanity's last exam be saturated? (>80%)
44
Ṁ1kṀ8.4k2030
3%
2025
28%
2026
34%
2027
11%
2028
5%
2029
3%
2030
15%
later / never
Resolves to the year in which an AI first achieves an accuracy of at least 80%.
Text-only models are allowed. o3-mini (high) is currently in the lead with an accuracy of 13.0%

This question is managed and resolved by Manifold.
Market context
Get
1,000 to start trading!
People are also trading
Will the first AI model that saturates Humanity's Last Exam be employable as a software engineer?
45% chance
Which of FrontierMath and Humanity's Last Exam will be saturated (>80%) first?
Top score on Humanity's Last Exam > 50% by 2028?
95% chance
Top score on Humanity's Last Exam > 50% by 2029?
99% chance
Top score on Humanity's Last Exam > 50% by 2027?
95% chance
Top score on Humanity's Last Exam > 90% by what year?
Top score on Humanity's Last Exam > 60% by what year?
Top score on Humanity's Last Exam > 80% by what year?
Top score on Humanity's Last Exam > 70% by what year?
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2030?
33% chance
Sort by:
What does this resolve to if it never gets >80%, e.g. if more than 20% of the questions are broken? I'm guessing "later"
People are also trading
Related questions
Will the first AI model that saturates Humanity's Last Exam be employable as a software engineer?
45% chance
Which of FrontierMath and Humanity's Last Exam will be saturated (>80%) first?
Top score on Humanity's Last Exam > 50% by 2028?
95% chance
Top score on Humanity's Last Exam > 50% by 2029?
99% chance
Top score on Humanity's Last Exam > 50% by 2027?
95% chance
Top score on Humanity's Last Exam > 90% by what year?
Top score on Humanity's Last Exam > 60% by what year?
Top score on Humanity's Last Exam > 80% by what year?
Top score on Humanity's Last Exam > 70% by what year?
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2030?
33% chance