Skip to content
Evaluation sources

Arena Creative Writing

LMArena · Humans blindly select stories, poems and other creative expressions to observe whether the works engage readers.

Official evaluation
In NewsRanked
Evidence budget5%
Upstream data as of11/11 08:00
Last synced11/16 02:05

What it measures, and how

Read the creative_writing category of the official text_style_control dataset and use the style-controlled Bradley–Terry scores and confidence intervals; scores from the overall text or professional writing categories are not borrowed.

How this evidence is used

Officially scored; 5% is split from the original 10% human-preference share, overall text keeps 5%, and the total budget does not increase. Shares an evidence family with other Arena tasks.

Results

Under fixed rules, each public model uses one representative configuration. Anonymous test variants are not shown, original leaderboard ranks are kept, and each item lists at most 30.

Rank thereModel thereRaw scoreRepresentative configuration
1Gemini 4 Argon (High)Google1,522.5High reasoning
2Claude Opus 5.5 (High)Anthropic1,517.1High reasoning
3Gemini 4 Carbon (High)google1,516.1High reasoning
4Claude Fable 5 (High)Anthropic1,501.2High reasoning
5Claude Opus 4.6 (High)Anthropic1,498.5High reasoning
6Gemini 4 Hydrogen (High)google1,491.8High reasoning
7Muse Wonder (Max)meta1,491.3Max reasoning
8Claude Fable 5.1 (Max)Anthropic1,490.4Max reasoning
9Claude Opus 4.7 (High)Anthropic1,489.4High reasoning
10Gemini 3.8 Flash (High)Google1,488.3High reasoning
11Gemini 3.7 Flash (High)Google1,487High reasoning
12Gemini 3 ProGoogle1,484.1Source default configuration
14Gemini 3.1 Pro PreviewGoogle1,481.7Source default configuration
16Claude Opus 5 (Max)Anthropic1,473.3Max reasoning
17Qwen3.8-MaxAlibaba1,471.5Source default configuration
18Gemini 3.6 Flash (High)Google1,471.3High reasoning
19GPT-5.6 Sol (xHigh)OpenAI1,471xHigh reasoning
21Claude Opus 4.8 (High)Anthropic1,469.9High reasoning
23Claude Opus 4.5 (High, 32K, 20251101)Anthropic1,468.9High reasoning
24Muse Spark 1.3 (Max)Meta1,467.9Max reasoning
25Gemini 3.5 Flash (High)Google1,465.3High reasoning
26Muse SparkMeta1,464.3Source default configuration
27Grok 4.20 Beta 1xAI1,464.2Source default configuration
29Claude Sonnet 5.5 (xHigh)anthropic1,463.7xHigh reasoning
31Kimi K3 (Max)Moonshot AI1,459.1Max reasoning
32Gemini 3 FlashGoogle1,456.3Source default configuration
33GLM-5.3 (Max)Z.ai1,455.8Max reasoning
35GPT-5.5 InstantOpenAI1,454.3Source default configuration
36Kimi K3.1 Pro (Max)moonshot1,453.1Max reasoning
37Grok 4.5xAI1,451.5Source default configuration
Limits and data attribution

Open user prompts are classified by a classifier and are not all long-form fiction or Chinese creative writing; votes include personal preference. There is overlap with Arena's overall text and professional writing categories, so it cannot serve as an additional independent institution.

Data licence: CC BY 4.0 · Arena official Hugging Face leaderboard-dataset; retain attribution and source links and explain aggregation changes.

Scores published by LMArena. Raw scores and the News consensus score use different scales and cannot be added directly.