Comparing 2 models

Gemini 3.1 Pro Preview vs GPT-6.1 Sol

Benchmarks through

Verdict

GPT-6.1 Sol places higher on 3 of the 5 tasks where both are ranked. GPT-6.1 Sol accepts 1.0x more context.

  • Choose Gemini 3.1 Pro Preview for Creative Writing (#3), Writing (#3).
  • Choose GPT-6.1 Sol for Translation (#3), Literary Translation (#3), Everyday Translation (#3).

Built from the published task rankings below; ranks come from each task's own weighted benchmarks, so a win on one task says nothing about another.

metric
Model 1Gemini 3.1 Pro Preview
Model 2GPT-6.1 Sol
Best for
Business Writing (#3)
Image Understanding (#2)
Provider
google
openai
Context
1.0M
1.1MBest
Input / 1M
$2Best
$2Best
Output / 1M
$12
$10Best
Tool use
yesBest
yesBest
Vision
yesBest
yesBest
Reasoning
yesBest
yesBest
Open-weight
—
—
Released
Feb 19, 2026
Sep 29, 2026

Measured head to head

Benchmarks both models were run on

EvaluationGemini 3.1 Pro PreviewGPT-6.1 SolSource
Design Arena Coding1220 Elo1362 Elosource · 2026-11-15
Design Arena UI1215 Elo1370 Elosource · 2026-11-15
Design Arena Web-app Agent1103 Elo1278 Elosource · 2026-11-15
Design Arena Website1225 Elo1315 Elosource · 2026-11-15
FACTS Grounding56.6%78%source · 2026-10-24
FrontierMath Tiers 1-3 (Epoch AI)59.6% ± 2.993.7% ± 1.4source · 2026-06-11
GPQA Diamond (Epoch AI)94.4% ± 1.695.4% ± 1.4source · 2026-08-06
GPQA Diamond (Epoch AI)94.1% ± 1.795.4% ± 1.4source · 2026-02-20
LiveBench Agentic Coding44.1%54.5%source · 2026-10-18
LiveBench Coding76.5%80.4%source · 2026-10-18
LiveBench Data Analysis78.5%82.7%source · 2026-10-18
LiveBench Instruction Following79.1%74.2%source · 2026-10-18
LiveBench Language85.4%90.1%source · 2026-10-18
LiveBench Math91.0%96.8%source · 2026-10-18
LiveBench Reasoning84%92.6%source · 2026-10-18
LMArena Agent-4.512.5source · 2026-11-11
LMArena Agent Bash Recovery-23.34.5source · 2026-10-08
LMArena Agent Steerability-8.213.4source · 2026-11-11
LMArena Agent Task Outcome-11.311.7source · 2026-11-11
LMArena Agent Tool Hallucination-0.41source · 2026-11-11
LMArena Creative Writing1483 Elo1420 Elosource · 2026-11-11
LMArena Instruction Following1465 Elo1463 Elosource · 2026-11-11
LMArena Long Query1482 Elo1459 Elosource · 2026-11-11
LMArena Math1485 Elo1475 Elosource · 2026-11-11
LMArena Text1487 Elo1481 Elosource · 2026-11-11
LMArena Text Factuality1472 Elo1468 Elosource · 2026-11-11
LMArena Vision1280 Elo1293 Elosource · 2026-11-09
LMArena Vision Diagrams1309 Elo1327 Elosource · 2026-11-09
LMArena Vision OCR1295 Elo1300 Elosource · 2026-11-09
LMArena WebDev1446 Elo1743 Elosource · 2026-11-11
LMArena WebDev Image-to-Web1480 Elo1696 Elosource · 2026-11-10
OTIS Mock AIME (Epoch AI)95.6% ± 3.1100% ± 0source · 2026-08-06
OTIS Mock AIME (Epoch AI)95.6% ± 3.1100% ± 0source · 2026-02-20
SimpleQA Verified (Epoch AI)73.5% ± 1.473.9% ± 1.4source · 2026-08-10

Values are as published by each evaluator, in its own units; rows from different evaluators are not on a common scale.

task evidence

How they place when the question changes

Lower ranks are better. “Best” marks the strongest option in this shortlist for that task.