Evaluation sourcesOfficial evaluation
FrontierMath v2 · Tier 4
Epoch AI / Reasoning · Harder mathematical research problems
In NewsRanked
Evidence budget1.2%
Upstream data as of09/30 06:00
Last synced10/01 20:05
What it measures, and how
Tier 4 is kept separate and shares the mathematical evidence budget with Tiers 1–3; sampling error is retained.
How this evidence is used
Officially scored; the same question family shares a fixed budget.
Results
Under fixed rules, each public model uses one representative configuration. Anonymous test variants are not shown, original leaderboard ranks are kept, and each item lists at most 30.
| Rank there | Model there | Raw score | Representative configuration |
|---|---|---|---|
| 1 | gpt-6.1-sol_max— | 100.0% | Max reasoning |
| 2 | gpt-6-astra_maxOpenAI | 97.6% | Max reasoning |
| 6 | claude-opus-5-5_maxAnthropic | 95.0% | Max reasoning |
| 7 | claude-fable-5_maxAnthropic | 90.2% | Max reasoning |
| 8 | gpt-6-sol_maxOpenAI | 90.0% | Max reasoning |
| 9 | claude-fable-5-1_maxAnthropic | 87.8% | Max reasoning |
| 11 | gpt-5.6-sol_maxOpenAI | 82.9% | Max reasoning |
| 13 | claude-sonnet-5-5_maxanthropic | 80.5% | Max reasoning |
| 15 | gpt-5.5-pro_xhighOpenAI | 78.0% | xHigh reasoning |
| 17 | claude-opus-5_maxAnthropic | 73.2% | Max reasoning |
| 18 | gpt-5.5_xhighOpenAI | 72.5% | xHigh reasoning |
| 19 | gpt-5.6-terra_maxOpenAI | 70.7% | Max reasoning |
| 20 | gpt-5.6-luna_maxOpenAI | 61.0% | Max reasoning |
| 21 | gpt-5.4-pro-2026-03-05_xhighOpenAI | 58.5% | xHigh reasoning |
| 22 | gpt-6-luna_maxOpenAI | 56.1% | Max reasoning |
| 22 | claude-opus-4-8_maxAnthropic | 56.1% | Max reasoning |
| 24 | gpt-5.4-2026-03-05_xhighOpenAI | 49.0% | xHigh reasoning |
| 25 | muse-spark-1.3_maxMeta | 46.3% | Max reasoning |
| 25 | qwen3.8-max_xhighAlibaba | 46.3% | xHigh reasoning |
| 27 | gpt-5.2-pro-2025-12-11_xhighOpenAI | 46.0% | xHigh reasoning |
| 29 | kimi-k3_maxMoonshot AI | 39.0% | Max reasoning |
| 30 | gemini-3.7-flash_highGoogle | 36.6% | High reasoning |
| 31 | qwen3.8-max-0902_xhighAlibaba | 34.1% | xHigh reasoning |
| 31 | qwen3.7-maxAlibaba | 34.1% | Source default configuration |
| 33 | claude-opus-4-7_maxAnthropic | 31.7% | Max reasoning |
| 33 | grok-4.6_xhighxAI | 31.7% | xHigh reasoning |
| 35 | gpt-5.2-2025-12-11_xhighOpenAI | 31.7% | xHigh reasoning |
| 36 | claude-sonnet-5_maxAnthropic | 29.3% | Max reasoning |
| 36 | glm-5.3_maxZ.ai | 29.3% | Max reasoning |
| 36 | glm-5.2_maxZ.ai | 29.3% | Max reasoning |
Limits and data attribution
Officially scored; the same question family shares a fixed budget.
Data licence: CC BY 4.0 · Epoch AI's own evaluation data
Scores published by Epoch AI. Raw scores and the News consensus score use different scales and cannot be added directly.