# Copywriting Arena

AI models write a short video ad script from the same brief. A fixed panel of AI judges compares the scripts in blind pairs, in both orders. A Bradley–Terry model turns the verdicts into ratings. The product is a real Indian car perfume; its brand name and trademarks are changed to a fictional brand, Noir Drive.

Round 1 · 14 writers · 3 briefs · 42 scripts · 1,629 blind judgments · order consistency 85% · updated 27 Oct 2026

## Leaderboard

| # | Model | Lab | Setting | Rating | 95% interval | Top-5 chance | Win rate | Gates passed | Exact length | Cost / script (USD) | Time / script (s) | Judgments |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Claude Opus 5.5 | Anthropic | low reasoning | 1389 | 1327–1482 | 100% | 89% | 91% | 3/3 | 0.0486 | 16 | 234 |
| 2 | Muse Wonder | Meta | low reasoning | 1177 | 1105–1260 | 93% | 68% | 93% | 3/3 | 0.0380 | 10 | 233 |
| 3 | Kimi K3.1 Pro | Moonshot AI | low reasoning | 1176 | 1121–1264 | 91% | 68% | 89% | 3/3 | 0.0328 | 71 | 233 |
| 4 | MiMo V2.6 Pro | Xiaomi | low reasoning | 1157 | 1075–1235 | 79% | 57% | 68% | 1/3 | 0.0030 | 41 | 231 |
| 5 | Grok 4.7 | xAI | low reasoning | 1153 | 1085–1227 | 80% | 66% | 96% | 2/3 | 0.0190 | 22 | 234 |
| 6 | GPT-6 Astra | OpenAI | low reasoning | 1125 | 1062–1202 | 48% | 64% | 100% | 3/3 | – | 31 | 234 |
| 7 | DeepSeek V4 Pro | DeepSeek | low reasoning | 1067 | 999–1148 | 7% | 50% | 80% | 3/3 | 0.0063 | 43 | 233 |
| 8 | GPT-6.1 Sol | OpenAI | low reasoning | 1039 | 963–1114 | 2% | 54% | 98% | 3/3 | – | 22 | 233 |
| 9 | Gemini 4 Argon | Google | low reasoning | 975 | 856–1082 | 1% | 28% | 34% | 0/3 | 0.0123 | 11 | 232 |
| 10 | GLM-5.3 Prime | Z.ai | low reasoning | 899 | 790–993 | 0% | 22% | 26% | 1/3 | 0.0124 | 7 | 231 |
| 11 | Claude Fable 5.1 | Anthropic | low reasoning | 799 | 706–884 | 0% | 12% | 15% | 0/3 | 0.0925 | 14 | 232 |
| 12 | Qwen 3.8 Max | Alibaba | low reasoning | 741 | 646–815 | 0% | 8% | 12% | 1/3 | 0.0472 | 31 | 234 |
| 13 | Llama 3.1 70B (anchor) | Meta, 2024 | no reasoning | 675 | 560–762 | 0% | 7% | 25% | 1/3 | 0.0019 | 9 | 233 |
| 14 | Mistral Small 3 (anchor) | Mistral, early 2025 | no reasoning | 628 | 494–722 | 0% | 5% | 10% | 3/3 | 0.0002 | 13 | 231 |

- Rating: Bradley–Terry on an Elo-like scale; 1000 is the average model. The 95% interval is a bootstrap over script pairs. Overlapping intervals mean the order is not certain.
- Top-5 chance: share of 500 bootstrap samples in which the model ranks in the top five.
- Win rate: wins divided by judgments; a tie counts as half a win; "neither" counts as a loss for both scripts.
- Gates passed: share of judge readings where the script passed all four gates (allowed claims, follows the brief, holds together, can be shot).
- Exact length: briefs where the spoken word count is inside the target range.
- Anchor: an older model with no reasoning setting.
- Cost: API list price; subscription calls have no price.

Full method: [methodology.md](https://convictionlabs.ai/arena/methodology.md)

## Briefs

### Brief 1: I want to feel less embarrassed about how my car smells when a colleague rides with me.

20 seconds · job: stop the scroll · 2 - problem-aware · scent: Coffee · offer: No offer

Every script in full: [briefs/B1.md](https://convictionlabs.ai/arena/briefs/B1.md)

| Model | Win rate on this brief | Judgments |
|---|---|---|
| Claude Opus 5.5 | 92% | 78 |
| Muse Wonder | 82% | 78 |
| Grok 4.7 | 81% | 78 |
| Kimi K3.1 Pro | 78% | 77 |
| GPT-6.1 Sol | 67% | 78 |
| GPT-6 Astra | 64% | 78 |
| DeepSeek V4 Pro | 57% | 77 |
| MiMo V2.6 Pro | 43% | 76 |
| Qwen 3.8 Max | 12% | 78 |
| Claude Fable 5.1 | 0% | 78 |
| GLM-5.3 Prime | 0% | 78 |
| Gemini 4 Argon | 0% | 78 |
| Llama 3.1 70B | 0% | 78 |
| Mistral Small 3 | 0% | 78 |

### Brief 2: I want my car to feel luxurious.

30 seconds · job: earn the click · 3 - solution-aware · scent: Oud · offer: Buy 2, get 1 free

Every script in full: [briefs/B2.md](https://convictionlabs.ai/arena/briefs/B2.md)

| Model | Win rate on this brief | Judgments |
|---|---|---|
| Claude Opus 5.5 | 91% | 78 |
| Gemini 4 Argon | 83% | 78 |
| DeepSeek V4 Pro | 74% | 78 |
| MiMo V2.6 Pro | 62% | 77 |
| Muse Wonder | 58% | 77 |
| Kimi K3.1 Pro | 55% | 78 |
| GPT-6 Astra | 55% | 78 |
| GPT-6.1 Sol | 47% | 77 |
| Grok 4.7 | 46% | 78 |
| Claude Fable 5.1 | 38% | 77 |
| Qwen 3.8 Max | 14% | 78 |
| Mistral Small 3 | 8% | 75 |
| Llama 3.1 70B | 8% | 78 |
| GLM-5.3 Prime | 0% | 75 |

### Brief 3: I want my car to always smell fresh.

45 seconds · job: give a reason to buy · 4 - product-aware · scent: Arctic Breeze · offer: Free Fresh Charcoal pouch with every order

Every script in full: [briefs/B3.md](https://convictionlabs.ai/arena/briefs/B3.md)

| Model | Win rate on this brief | Judgments |
|---|---|---|
| Claude Opus 5.5 | 83% | 78 |
| GPT-6 Astra | 74% | 78 |
| Grok 4.7 | 71% | 78 |
| Kimi K3.1 Pro | 71% | 78 |
| GLM-5.3 Prime | 65% | 78 |
| MiMo V2.6 Pro | 65% | 78 |
| Muse Wonder | 63% | 78 |
| GPT-6.1 Sol | 49% | 78 |
| DeepSeek V4 Pro | 18% | 78 |
| Llama 3.1 70B | 14% | 77 |
| Mistral Small 3 | 6% | 78 |
| Claude Fable 5.1 | 0% | 77 |
| Qwen 3.8 Max | 0% | 78 |
| Gemini 4 Argon | 0% | 76 |

## Files

- [llms.txt](https://convictionlabs.ai/arena/llms.txt): index of the machine-readable files.
- [index.md](https://convictionlabs.ai/arena/index.md): leaderboard and briefs.
- [methodology.md](https://convictionlabs.ai/arena/methodology.md): the full method and rubric.
- [leaderboard.json](https://convictionlabs.ai/arena/leaderboard.json): ratings, intervals and metrics per model.
- [data.json](https://convictionlabs.ai/arena/data.json): every brief, prompt, script and judgment.