The Decoder· Matthias Bastian·· 1 d ago
Gemini 4 Carbon takes the MathArena crown but costs 15 times more than GPT-6.1 Sol
Gemini 4 Carbon takes the MathArena crown but costs 15 times more than GPT-6.1 Sol
AI summary
For the first time in a while, no OpenAI model leads the MathArena AI math benchmark. Google's Gemini 4 Carbon and Anthropic's Fable 5.2 have knocked GPT-6.1 Sol from the top, though both cost significantly more. Gemini ignored the time limit in testing and almost never gave up on a task.
Selection record
Threshold 76Media and individualsFirst 58Second 62
Not admittedSum of both 120 < twice the threshold 152
- Source tier
- Media and individuals; this tier's threshold is 76
- Pre-filter
- passed：评测Gemini等模型数学基准表现与成本
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: The Decoder · the-decoder.com