Comparing 2 models

Gemini 3.1 Pro Preview vs GPT-6 Astra

Benchmarks through

Verdict

Gemini 3.1 Pro Preview places higher on 6 of the 9 tasks where both are ranked. Gemini 3.1 Pro Preview costs 5.0x less per input token. GPT-6 Astra accepts 1.0x more context.

  • Choose Gemini 3.1 Pro Preview for Chat & Roleplay (#3), Roleplay & Character (#3), Creative Writing (#3).
  • Choose GPT-6 Astra for Translation (#4), Literary Translation (#4), Everyday Translation (#4).

Built from the published task rankings below; ranks come from each task's own weighted benchmarks, so a win on one task says nothing about another.

metric
Model 1Gemini 3.1 Pro Preview
Model 2GPT-6 Astra
Best for
Business Writing (#3)
Grounded RAG (#2)
Provider
google
openai
Context
1.0M
1.1MBest
Input / 1M
$2Best
$10
Output / 1M
$12Best
$50
Tool use
yesBest
yesBest
Vision
yesBest
yesBest
Reasoning
yesBest
yesBest
Open-weight
—
—
Released
Feb 19, 2026
Sep 4, 2026

Measured head to head

Benchmarks both models were run on

EvaluationGemini 3.1 Pro PreviewGPT-6 AstraSource
FACTS Grounding56.6%80.1%source · 2026-10-24
FrontierMath Tiers 1-3 (Epoch AI)59.6% ± 2.993.7% ± 1.4source · 2026-06-11
GPQA Diamond (Epoch AI)94.4% ± 1.695.8% ± 1.4source · 2026-08-06
GPQA Diamond (Epoch AI)94.1% ± 1.795.8% ± 1.4source · 2026-02-20
LiveBench Agentic Coding44.1%57.3%source · 2026-10-18
LiveBench Coding76.5%80.4%source · 2026-10-18
LiveBench Data Analysis78.5%83.0%source · 2026-10-18
LiveBench Instruction Following79.1%75.6%source · 2026-10-18
LiveBench Language85.4%89.4%source · 2026-10-18
LiveBench Math91.0%96.8%source · 2026-10-18
LiveBench Reasoning84%92.7%source · 2026-10-18
LMArena Agent-4.514.5source · 2026-11-11
LMArena Agent Bash Recovery-23.35.5source · 2026-10-08
LMArena Agent Steerability-8.214.8source · 2026-11-11
LMArena Agent Task Outcome-11.314source · 2026-11-11
LMArena Agent Tool Hallucination-0.41source · 2026-11-11
LMArena Creative Writing1483 Elo1421 Elosource · 2026-11-11
LMArena Instruction Following1465 Elo1456 Elosource · 2026-11-11
LMArena Long Query1482 Elo1459 Elosource · 2026-11-11
LMArena Math1485 Elo1459 Elosource · 2026-11-11
LMArena Text1487 Elo1474 Elosource · 2026-11-11
LMArena Text Factuality1472 Elo1466 Elosource · 2026-11-11
LMArena Vision1280 Elo1283 Elosource · 2026-11-09
LMArena Vision Diagrams1309 Elo1311 Elosource · 2026-11-09
LMArena Vision OCR1295 Elo1297 Elosource · 2026-11-09
LMArena WebDev1446 Elo1764 Elosource · 2026-11-11
LMArena WebDev Image-to-Web1480 Elo1722 Elosource · 2026-11-10
OTIS Mock AIME (Epoch AI)95.6% ± 3.1100% ± 0source · 2026-08-06
OTIS Mock AIME (Epoch AI)95.6% ± 3.1100% ± 0source · 2026-02-20
SimpleQA Verified (Epoch AI)73.5% ± 1.475.6% ± 1.4source · 2026-08-10

Values are as published by each evaluator, in its own units; rows from different evaluators are not on a common scale.