Skip to content
Evaluation sources

TapTap Maker Benchmark

TapTap Maker / Coding · Writing working features in Lua inside a real game engine. The score is judged by engine execution, not by another model.

Official evaluation
In NewsRanked
Evidence budget3.6%
Upstream data as of11/05 08:00
Last synced11/16 02:05

What it measures, and how

Only the official main_board L2 pass rate is used; cost, speed, Held-out and category scores are not voted on again. For the same base model, the representative row is chosen by a fixed reasoning-tier priority, and the choice does not look at scores.

How this evidence is used

3.6% of the coding and design budget; engine and L2 metrics fixed.

Results

Under fixed rules, each public model uses one representative configuration. Anonymous test variants are not shown, original leaderboard ranks are kept, and each item lists at most 30.

Rank thereModel thereRaw scoreRepresentative configuration
1gpt-6-astraOpenAI87.2%xHigh reasoning
2claude-fable-5-1Anthropic86.9%High reasoning
3claude-opus-5-5Anthropic86.9%xHigh reasoning
4gpt-6.1-sol—86.7%xHigh reasoning
5gpt-6.1-terraOpenAI85.5%xHigh reasoning
6claude-sonnet-5-5anthropic84.0%xHigh reasoning
7gemini-4-argonGoogle83.2%High reasoning
8hy4hunyuan81.8%High reasoning
10deepseek-v4.1-flash-1017deepseek80.3%Max reasoning
11gemini-3.8-flashGoogle80.1%High reasoning
12gpt-5.6-solOpenAI79.8%xHigh reasoning
13grok-4.7-highxai77.9%High reasoning
14grok-4.7-xhighxai77.8%xHigh reasoning
15qwen3.8-maxAlibaba77.5%xHigh reasoning
16claude-haiku-5-5—77.2%xHigh reasoning
17gpt-6-solOpenAI76.8%xHigh reasoning
18kimi-k3.1-promoonshot76.8%Max reasoning
19gpt-6-lunaOpenAI76.6%xHigh reasoning
20qwen3.8-max-0902Alibaba76.2%xHigh reasoning
21glm-5.3Z.ai76.2%Max reasoning
22deepseek-v4.1-flashDeepSeek76.1%Max reasoning
23qwen3.8-flashAlibaba76.0%xHigh reasoning
24gpt-5.6-terraOpenAI75.6%xHigh reasoning
25mimo-v2.6-proXiaomi75.4%Source default configuration
26glm-5.3-flashZ.ai75.0%Max reasoning
27hy4-previewTencent72.5%High reasoning
28kimi-k3Moonshot AI72.5%Source default configuration
29gpt-5.6-lunaOpenAI72.2%xHigh reasoning
30grok-4.5xAI72.0%High reasoning
31doubao-seed-evolvingByteDance71.6%High reasoning
Limits and data attribution

Single engine, single language, and cannot be generalised to other tech stacks; different models may use different agent drivers, and a closed-source harness cannot be recomputed question by question.

Data licence: Official public results; public re-display retains official attribution, and full redistribution authorisation remains subject to Yìwán/TapTap terms

Scores published by TapTap Maker. Raw scores and the News consensus score use different scales and cannot be added directly.