Skip to content
Evaluation sources

LiveBench · reasoning and maths

LiveBench / Reasoning · Average of the Reasoning and Mathematics items, each weighted 50%.

Official evaluation
In NewsRanked
Evidence budget4.2%
Upstream data as of10/13 06:59
Last synced10/19 02:05

What it measures, and how

First calculate the Reasoning and Mathematics category scores separately, then average them at 50% each and keep one decimal place. The two-item average differs from the official site's score when either category is selected alone.

How this evidence is used

The average of the two items participates in the ranking as one piece of evidence, and the dedicated categories share the LiveBench evidence family; the Global Average is for reference only and is not counted twice.

Results

Under fixed rules, each public model uses one representative configuration. Anonymous test variants are not shown, original leaderboard ranks are kept, and each item lists at most 30.

Rank thereModel thereRaw scoreRepresentative configuration
1gpt-6.1-sol-max—94.7%Max reasoning
2gpt-6-astra-maxOpenAI94.7%Max reasoning
3claude-opus-5-5-max-effortAnthropic94.6%Max reasoning
4claude-fable-5-1-max-effortAnthropic94.3%Max reasoning
6gpt-5.6-sol-maxOpenAI93.9%Max reasoning
7claude-sonnet-5-5-max-effortanthropic93.9%Max reasoning
9muse-wonder-1.0-max—93.6%Max reasoning
10claude-opus-5-max-effortAnthropic93.5%Max reasoning
11claude-fable-5-max-effortAnthropic92.8%Max reasoning
12muse-spark-1.3-xhighMeta92.8%xHigh reasoning
13gpt-5.6-terra-maxOpenAI92.8%Max reasoning
14gpt-5.5-xhighOpenAI92.8%xHigh reasoning
15gpt-6-sol-maxOpenAI92.5%Max reasoning
16claude-opus-4-8-max-effortAnthropic91.8%Max reasoning
18grok-4.6xAI91.5%Source default configuration
19gpt-5.4-xhighOpenAI91.1%xHigh reasoning
20claude-sonnet-5-xhigh-effortAnthropic90.8%xHigh reasoning
21gemini-3.7-flash-highGoogle90.6%High reasoning
22muse-spark-1.2-xhighMeta90.6%xHigh reasoning
23deepseek-v4-pro-0813DeepSeek90.5%Source default configuration
24gemini-3.8-flash-highGoogle90.4%High reasoning
25claude-opus-4-7-xhigh-effortAnthropic90.0%xHigh reasoning
26deepseek-v4.1-flash-maxDeepSeek90.0%Source default configuration
27qwen3.8-maxAlibaba89.8%Source default configuration
28grok-4.7-xhighxAI89.2%xHigh reasoning
29grok-4.5xAI89.0%Source default configuration
30claude-opus-4-6-thinking-auto-high-effortAnthropic89.0%High reasoning
31mistral-large-4-high—88.8%Source default configuration
32gpt-5.2-2025-12-11-highOpenAI88.2%High reasoning
33smaug-flashAbacus.AI88.1%Source default configuration
Limits and data attribution

The average of the two items measures combined performance and must not be treated as a Reasoning single-item score. Scores and rankings change when the official page switches categories or whether fine-tuned models are included. Organisational participant Abacus.AI also develops the Smaug model, and its exclusive scores need to be supplemented by other independent sources.

Data licence: Apache 2.0

Item scores are published by LiveBench, and News aggregates and ranks the above two categories with equal weight. The two-item average and the News consensus score use different scales and cannot be added directly.