Highest score on Humanity's Last Exam before Dec 31, 2026?
Short Answer
1. Market Behavior & Drivers
- Since last update (~126d): Market for "At least 75%" surged +66.0pp, flipping the edge, with market_led.
- Our model led with a +44.9pp gain for "At least 70%", widening the edge.
- Headline market probability grew +11.0pp versus model's +9.2pp, compressing the edge.
- For "At least 65%", our model rose +27.4pp while market fell -1.0pp, widening the edge.
- A score of at least 55% appears very likely, exceeding the current 54.80% top.
- Scores of 70% and 75% are significantly less likely than 60% or 65%.
- HLE question set or scoring rubric updates are highly likely before 2027.
Who Wins and Why
| Outcome | Market | Model | Why |
|---|---|---|---|
| At least 60% | 60.0% | 78.0% | A year-end forecast with a central estimate near 62% makes this outcome plausible. |
| At least 65% | 38.0% | 68.7% | This threshold is above the year-end forecast's central estimate near 62%. |
| At least 55% | 98.0% | 96.3% | The current top score of 54.80% suggests this threshold is near current performance. |
| At least 70% | 20.0% | 68.7% | The current top score and year-end forecast suggest this threshold appears overly optimistic. |
| At least 50% | 99.0% | 98.1% | The current highest verified score on the official Humanity's Last Exam is 54.80%. |
Current Context
Sources (10)
- 1Humanity's Last Exam Leaderboard | LLMBoardllmboard.ai
- 2Humanity's Last Exam - Scale Labs Leaderboardlabs.scale.com
- 3Humanity's Last Exam Benchmark Leaderboard - Artificial Analysisartificialanalysis.ai
- 4SciMaster: Towards General-Purpose Scientific AI Agents Part I. X-Master as Foundation — Can We Lead on Humanity’s Last Exam?arxiv.org
- 5Humanity’s Last Examarxiv.org
- 6HLE-Verified: A Systematic Verification and Structured Revision of Humanity’s Last Examarxiv.org
- 7Highest score on Humanity's Last Exam before end of year? - Kalshikalshi.com
- 8https://polymarket.com/event/highest-score-on-humanitys-last-exam-in-2026-20260723190142922polymarket.com
- 9Dimensionality and Measurement Precision in HLE’s Multiple-Choice Subsetarxiv.org
- 10TruthTensor: Evaluating LLMs through Human Imitation on Prediction Market under Drift and Holistic Reasoningarxiv.org
2. Price Chart
Historical Price (Probability)
3. Significant Price Movements
Notable price changes detected in the chart, along with research into what caused each movement.
Outcome: At least 75%
📈 September 23, 2026: 73.0pp spike
Price increased from 14.0% to 87.0%
Outcome: At least 60%
📈 September 15, 2026: 13.0pp spike
Price increased from 45.0% to 58.0%
📈 September 12, 2026: 9.0pp spike
Price increased from 54.0% to 63.0%
Outcome: At least 65%
📈 September 14, 2026: 11.0pp spike
Price increased from 40.0% to 51.0%
📉 September 13, 2026: 35.0pp drop
Price decreased from 75.0% to 40.0%
Sources (13)
- 1TUMIX: Multi-Agent Test-Time Scaling with Tool-Use Mixturearxiv.org
- 2HLE-Verified: A Systematic Verification and Structured Revision of Humanity’s Last Examarxiv.org
- 3Benchmark Radar: A Living Database and Search Engine for AI...arxiv.org
- 4Humanity's Last Exam Leaderboard | LLMBoardllmboard.ai
- 5Humanity's Last Exam Leaderboard - LLM Statsllm-stats.com
- 6HLE Leaderboard (September 2026): Claude Fable 5.1 Leads at 65%benchlm.ai
- 7Humanity's Last Exam: A Complete Guide to the AI Benchmark - AI Instant Newsaiinstantnews.com
- 8Next Grok Model (4.6+): Humanity’s Last Exam Debut? - Polymarket noteringen | CoinRithmcoinrithm.com
- 9HLE-Verified: A Systematic Verification and Structured Revision of Humanity’s Last Examarxiv.org
- 10HLE-Verified: A Systematic Verification and Structured Revision of Humanity’s Last Examarxiv.org
- 11Humanity's Last Exam Benchmark Scores & AI Model Leaderboard | BenchmarkListbenchmarklist.com
- 12Humanity's Last Exam Leaderboard & Results | AI Atlasai-atlas.co
- 13Frontier AI models gained 30 percentage points in a year on Humanity's Last Exam, a test built to defeat themspacemart.com
4. Market Data
Contract Snapshot
This market will resolve to YES if the highest score on "Humanity's Last Exam" is 65% or greater. It will resolve to NO if the highest score is less than 65%. The resolution will be determined by December 31, 2026.
Available Contracts
Market options and current pricing
| Outcome bucket | Yes (price) | No (price) | Last trade probability |
|---|---|---|---|
| At least 50% | $1.00 | $0.03 | 99% |
| At least 55% | $0.99 | $0.06 | 98% |
| At least 75% | $0.75 | $0.95 | 87% |
| At least 60% | $0.74 | $0.54 | 60% |
| At least 80% | $0.12 | $0.97 | 53% |
| At least 65% | $0.56 | $0.59 | 38% |
| At least 70% | $0.59 | $0.81 | 20% |
| At least 90% | $0.20 | $0.99 | 9% |
| At least 85% | $1.00 | $1.00 | 4% |
Market Discussion
As of September 24, 2026, the highest publicly listed Humanity's Last Exam score is 59.1% by Anthropic's Claude Fable 5.1, with other Claude variants and GPT-6 Astra following closely [1][2][3][4][5]. Prediction market sentiment positions Anthropic as the current favorite, with expectations for continued rapid score growth, potentially reaching around 65% by December 31, 2026, through new model releases and enhanced reasoning [6][7][8][9][10][11][12][13][14][15][16]. However, comparisons are complicated by differing leaderboard versions and weakening measurement precision at the frontier [2][17][18][16].
Sources (18)
- 1Humanity's Last Exam Benchmark Leaderboard | Artificial Analysisartificialanalysis.ai
- 2Humanity's Last Exam - Scale Labs Leaderboardlabs.scale.com
- 3Humanity's Last Exam Leaderboard & Results | AI Atlasai-atlas.co
- 4Humanity's Last Exam Leaderboard 2026 - Compare AI Model Scorespricepertoken.com
- 5Humanity's Last Exam (AA) leaderboard: 544 AI models ranked | BenchLeaderbenchleader.com
- 6https://polymarket.com/event/highest-score-on-humanitys-last-exam-in-2026-20260723190142922polymarket.com
- 7https://polymarket.com/event/highest-google-gemini-score-on-humanitys-last-exam-in-2026-20260723192605545polymarket.com
- 8https://polymarket.com/event/highest-meta-score-on-humanitys-last-exam-in-2026-20260723192006805polymarket.com
- 9https://polymarket.com/pt/event/highest-claude-score-on-humanitys-last-exam-in-2026-20260723190836285polymarket.com
- 10https://polymarket.copilot.markets/event/highest-claude-score-on-humanitys-last-exam-in-2026-20260723190836285polymarket.copilot.markets
- 11https://polymarket.copilot.markets/id/event/highest-openai-score-on-humanitys-last-exam-in-2026-20260723225144062polymarket.copilot.markets
- 12Will the highest score achieved by a Moonshot Kimi model on Humanity’s Last Exam in 2026 be 45% or higher? | Paritypredictparity.com
- 13[2607.20268v1] PoTRE: Test-Time Reasoning inspired by Cognitive Heterogeneityarxiv.org
- 14SciMaster: Towards General-Purpose Scientific AI Agents, Part I. X-Master as Foundation: Can We Lead on Humanity's Last Exam?arxiv.org
- 15[2508.02789v1] Cognitive Loop via In-Situ Optimization: Self-Adaptive Reasoning for Sciencearxiv.org
- 16[2609.27176] Beyond Overlap: Estimating the Causal Effect of Benchmark Exposurearxiv.org
- 17GPT-6 Astra: A new generation of intelligence - OpenAIopenai.com
- 18Dimensionality and Measurement Precision in HLE’s Multiple-Choice Subsetarxiv.org
5. Trust Index
Primary risk· Trade quality
Weighted blend with hard caps — a critically weak safety pillar, or a severe trading anomaly, caps the total regardless of the rest. Full methodology · About the Trust Index
6. What is the likelihood of Scale AI updating the Humanity's Last Exam question set or scoring rubric before 2027, and how could such changes impact model scores?
| Likelihood of HLE update by 2027 | 80–90% [1][2][3] |
|---|---|
| Probability of fixed leaderboard replacement | 20–35% [1][2][3] |
| Potential score impact from changes | Several percentage points (up or down) [2][3][4] |
Sources (6)
- 1Humanity's Last Exam - Scale Labs Leaderboardlabs.scale.com
- 2Introducing HLE-Diamond | Humanity's Last Examlastexam.ai
- 3Humanity's Last Examlastexam.ai
- 4Highest score on Humanity's Last Exam before Dec 31, 2026? - Kalshi Odds | CoinRithmcoinrithm.com
- 5Humanity's Last Exam - Wikipediaen.wikipedia.org
- 6Humanity's Last Exam Benchmark Leaderboard - Artificial Analysisartificialanalysis.ai
7. How does Scale AI's official 2,500-question HLE leaderboard methodology differ from other aggregators, and what is the current verified top score?
| Official HLE Top Score | 54.80% 1.94 pp (GPT 6 Astra, Sep 24, 2026) [1] |
|---|---|
| Official HLE Question Count | 2,500 questions [1] |
| Prediction Market Threshold | 60% accuracy by Dec 31, 2026 [1][2] |
Sources (5)
- 1Humanity's Last Exam - Scale Labs Leaderboardlabs.scale.com
- 2Highest score on Humanity's Last Exam before Dec 31, 2026? - Kalshi Odds | CoinRithmcoinrithm.com
- 3Humanity's Last Exam Benchmark Leaderboard - Artificial Analysisartificialanalysis.ai
- 4Artificial Analysis Intelligence Benchmarking Methodologyartificialanalysis.ai
- 5Humanity's Last Exam Leaderboard - LLM Statsllm-stats.com
8. How do the architectural approaches of Anthropic's Claude 5 series and OpenAI's GPT-6 series compare in their ability to solve the complex reasoning problems on Humanity's Last Exam?
| Claude Fable 5.1 HLE Score | 59.1% and 65.0% (September 24, 2026 [1][2]) |
|---|---|
| Claude Opus 5 HLE Score | 64.7% (September 24, 2026 [1][2]) |
| GPT-6 Astra HLE Score (reported) | 54.7% (September 24, 2026 [1]) |
Sources (12)
- 1Humanity's Last Exam Benchmark Leaderboard - Artificial Analysisartificialanalysis.ai
- 2Humanity's Last Exam Leaderboard 2026 - Compare AI Model Scorespricepertoken.com
- 3GPT-6 Astra: A new generation of intelligence | OpenAIopenai.com
- 4Introducing Claude Opus 5 - Anthropicanthropic.com
- 5Claude Fable 5 and Claude Mythos 5 - Anthropicanthropic.com
- 6Introducing GPT‑6 Sol and Luna - OpenAIopenai.com
- 7Humanity's Last Examagi.safe.ai
- 8Humanity's Last Exam Leaderboard - LLM Statsllm-stats.com
- 9Introducing Claude Opus 4.6 - Anthropicanthropic.com
- 10Humanity's Last Exam - arXiv.orgarxiv.org
- 11OpenAI’s Astra Model: Humanity’s Last Exam Debut?polymarket.com
- 12Claude Opus 5 System Card | alphaXivalphaxiv.org
9. Which public sources provide the most reliable data for tracking performance on the official Humanity's Last Exam leaderboard ahead of the December 31, 2026 deadline?
| Official Leaderboard | lastexam.ai/leaderboard and labs.scale.com/leaderboard/humanitys_last_exam [1][2] |
|---|---|
| Official HLE Questions | 2,500 questions across more than 100 subjects [3][4][5] |
| Ranking Metric | Rank (Upper Bound) based on 95% confidence intervals [1] |
Sources (10)
- 1Humanity's Last Exam - Scale Labs Leaderboardlabs.scale.com
- 2Humanity's Last Examlastexam.ai
- 3Humanity's Last Examagi.safe.ai
- 4Humanity's Last Examlastexam.ai
- 5[2501.14249] Humanity's Last Exam - arXivlastexam.ai
- 6Humanity's Last Exam Benchmark Leaderboard - Artificial Analysisartificialanalysis.ai
- 7Humanity's Last Exam Leaderboard 2026 - Compare AI Model Scorespricepertoken.com
- 8Humanity's Last Exam (HLE) benchmark: model scores & leaderboardsophon.at
- 9Introducing HLE-Diamond | Humanity's Last Examlastexam.ai
- 10HLE Leaderboard for Agents with Tools - a Hugging Face Space by...huggingface.co
10. What has been the historical rate of improvement for frontier models on Humanity's Last Exam and comparable reasoning benchmarks over the last 18 months?
| Initial HLE Score | 9.4% (DeepSeek-R1 in early 2025) [1][2] |
|---|---|
| HLE Score by Sept 2026 | 65% (Claude Fable 5.1) [3][4] |
| HLE Score Increase (1 year) | Approximately 30 percentage points (over past 12 months) [5] |
Sources (8)
- 1Humanity's Last Examagi.safe.ai
- 2A benchmark of expert-level academic questions to assess... - Naturenature.com
- 3Humanity's Last Exam Benchmark Leaderboard - Artificial Analysisartificialanalysis.ai
- 4HLE Leaderboard (September 2026): Claude Fable 5.1 Leads at 65%benchlm.ai
- 5Technical Performance | The 2026 AI Index Report | Stanford HAIhai.stanford.edu
- 6Large Language Model Benchmarks: A Taxonomy of Capabilities...mdpi.com
- 7LLM Benchmarks Compared: MMLU, HumanEval, GSM8K and More...lxt.ai
- 8AI Benchmark Guide | DemandSpheredemandsphere.com
11. What Could Change the Odds
Key Catalysts
Key Dates & Catalysts
- Strike Date: December 31, 2026
- Expiration: December 31, 2026
- Closes: December 31, 2026
Sources (14)
- 1Another Frontier Math Problem Solved by October 31? Odds | Lines.comlines.com
- 2Technology Prediction Markets & Live Odds 2026 | Polymarketpolymarket.com
- 3Humanity's Last Exam Benchmark Leaderboard - Artificial Analysisartificialanalysis.ai
- 4AA Humanity's Last Exam leaderboard: Claude Fable 5.1 leads 185 modelsmodelcap.ai
- 5Humanity's Last Exam Benchmark Scores & AI Model Leaderboard | BenchmarkListbenchmarklist.com
- 6Technical Performance | The 2026 AI Index Report | Stanford HAIhai.stanford.edu
- 7Benchmark Radar: A Living Database and Search Engine for AI...arxiv.org
- 8HLE-Verified: A Systematic Verification and Structured Revision of Humanity’s Last Examarxiv.org
- 9OpenAI’s Astra released by…?polymarket.com
- 10GPT-6 Released by…? OpenAI’s 2026 Deadline Market | Lines.comlines.com
- 11Next Claude Opus released by...?polymarket.com
- 12[2609.16642] From Public Evidence to Contractual Outcome: First and Stable Decidability on Kalshiarxiv.org
- 13Humanity’s Last Examarxiv.org
- 14[2501.14249] Humanity's Last Exam - arXivarxiv.org