Comparing 2 models
Claude Opus 5.5 vs Gemini 3.1 Pro Preview
Benchmarks through
Verdict
Gemini 3.1 Pro Preview places higher on 2 of the 2 tasks where both are ranked. Gemini 3.1 Pro Preview costs 2.0x less per input token. Gemini 3.1 Pro Preview accepts 1.0x more context.
- Choose Gemini 3.1 Pro Preview for Chat & Roleplay (#3), Roleplay & Character (#3).
Built from the published task rankings below; ranks come from each task's own weighted benchmarks, so a win on one task says nothing about another.
Measured head to head
Benchmarks both models were run on
| Evaluation | Claude Opus 5.5 | Gemini 3.1 Pro Preview | Source |
|---|---|---|---|
| Design Arena Coding | 1385 Elo | 1220 Elo | source · 2026-11-15 |
| Design Arena Full-stack Agent | 1389 Elo | 1041 Elo | source · 2026-11-15 |
| Design Arena UI | 1375 Elo | 1215 Elo | source · 2026-11-15 |
| Design Arena Web-app Agent | 1321 Elo | 1103 Elo | source · 2026-11-15 |
| Design Arena Website | 1326 Elo | 1225 Elo | source · 2026-11-15 |
| FACTS Grounding | 62.4% | 56.6% | source · 2026-10-24 |
| FrontierMath Tiers 1-3 (Epoch AI) | 91.2% ± 1.7 | 59.6% ± 2.9 | source · 2026-09-22 |
| GPQA Diamond (Epoch AI) | 90.6% ± 1.9 | 94.1% ± 1.7 | source · 2026-09-22 |
| LiveBench Agentic Coding | 71.7% | 44.1% | source · 2026-10-18 |
| LiveBench Coding | 89.3% | 76.5% | source · 2026-10-18 |
| LiveBench Data Analysis | 80.3% | 78.5% | source · 2026-10-18 |
| LiveBench Instruction Following | 65.7% | 79.1% | source · 2026-10-18 |
| LiveBench Language | 86.3% | 85.4% | source · 2026-10-18 |
| LiveBench Math | 97.1% | 91.0% | source · 2026-10-18 |
| LiveBench Reasoning | 92.2% | 84% | source · 2026-10-18 |
| LMArena Agent | 19.5 | -4.5 | source · 2026-11-11 |
| LMArena Agent Bash Recovery | 13.6 | -23.3 | source · 2026-10-08 |
| LMArena Agent Steerability | 18.6 | -8.2 | source · 2026-11-11 |
| LMArena Agent Task Outcome | 20.7 | -11.3 | source · 2026-11-11 |
| LMArena Agent Tool Hallucination | 0.7 | -0.4 | source · 2026-11-11 |
| LMArena Creative Writing | 1532 Elo | 1483 Elo | source · 2026-11-11 |
| LMArena Instruction Following | 1535 Elo | 1465 Elo | source · 2026-11-11 |
| LMArena Long Query | 1528 Elo | 1482 Elo | source · 2026-11-11 |
| LMArena Math | 1520 Elo | 1485 Elo | source · 2026-11-11 |
| LMArena Text | 1507 Elo | 1487 Elo | source · 2026-11-11 |
| LMArena Text Factuality | 1505 Elo | 1472 Elo | source · 2026-11-11 |
| LMArena Vision | 1295 Elo | 1280 Elo | source · 2026-11-09 |
| LMArena Vision Diagrams | 1339 Elo | 1309 Elo | source · 2026-11-09 |
| LMArena Vision OCR | 1312 Elo | 1295 Elo | source · 2026-11-09 |
| LMArena WebDev | 1815 Elo | 1446 Elo | source · 2026-11-11 |
| LMArena WebDev Image-to-Web | 1752 Elo | 1480 Elo | source · 2026-11-10 |
| OTIS Mock AIME (Epoch AI) | 100% ± 0 | 95.6% ± 3.1 | source · 2026-09-22 |
| SimpleQA Verified (Epoch AI) | 72.2% ± 1.4 | 73.5% ± 1.4 | source · 2026-09-22 |
Values are as published by each evaluator, in its own units; rows from different evaluators are not on a common scale.
task evidence
How they place when the question changes
Lower ranks are better. “Best” marks the strongest option in this shortlist for that task.