Task ranking
Best LLM for Summarization
Gemini 4 Carbon ranks first for Summarization as of November 15, 2026.[1][2] It ranks #1 of 148 on LMArena's long-query category (Elo 1549), based on blind human preference for longer prompts. Gemini 3.7 Flash is the next-ranked alternative. It scores 79.93% on LiveBench Instruction Following (#2 of 59), including paraphrasing, simplifying, story generation, and summarization.
- Best non-Google pick: Muse Spark 1.3 (#4)
- Compare Gemini 4 Carbon vs Gemini 3.7 Flash →
About this recommendation
- Updated
- Evidence through
- Sources
- 16
- Revision
- v132
Decision audit
Why this result
Inspect the inputs and the computed order behind the recommendation.
Models screened
24
live candidates
Evaluation feeds
6
task-weighted
Winner coverage
45%
intended feed weight
Largest provider share
5 of 8
Google: Gemini 4 Carbon leads the measured task comparison with 2 independent evaluation families. Community volume, release age and usage popularity add no ranking points.
Real-world track record is still developing. The recommendation can lead on independent measurements while practitioner reports accumulate.
Sources evaluated
These are the weights used in scoring. Missing measurements are omitted from each model’s average. A feed with no result for any model released in the last 60 days is stale and does not score until it catches up.
| Evaluation feed | Weight | Winner result | Field measured |
|---|---|---|---|
| FACTS GroundingObserved 2026-10-29 · evaluated 2026-10-29 · Gemini 4 Carbon | 38% | #6 | 13/24 |
| LiveBench Instruction Followingfailing; last successful check 2026-10-18 | 31% | not measured | 20/24 |
| LMArena Documentstale | 0% | no current result | 0/24 |
| LongBench v2disabled; last successful check unknownunavailable | 0% | feed unavailable | 0/24 |
| LMArena Long QueryObserved 2026-11-11 · evaluation date not supplied · high effort | 15% | #1 | 24/24 |
| LMArena Text FactualityObserved 2026-11-11 · evaluation date not supplied · high effort | 15% | #1 | 24/24 |
Provider concentration
Each exact model is scored separately; provider identity is not a ranking input.
- Google5 models
- OpenAI2 models
- Meta1 model
Decision table
Every published model is shown in computed order. Practitioner sources are distinct community threads, not the citations repeated in the prose below.
Google · coverage 45%
#1 LMArena Long Query · #1 LMArena Text Factuality
Google · coverage 40%
#2 LiveBench Instruction Following · #13 LMArena Long Query
Google · coverage 45%
#2 LMArena Long Query · #4 LMArena Text Factuality
Meta · coverage 40%
#4 LiveBench Instruction Following · #13 LMArena Text Factuality
Google · coverage 65%
#1 LiveBench Instruction Following · #9 LMArena Long Query
OpenAI · coverage 65%
#3 FACTS Grounding · #7 LiveBench Instruction Following
OpenAI · coverage 65%
#4 FACTS Grounding · #11 LiveBench Instruction Following
Google · coverage 40%
#6 LiveBench Instruction Following · #15 LMArena Text Factuality
Task score averages the available, task-weighted measurements. Benchmark positions compare models matched to our catalog. Models measured by at least two independent evaluator families are considered first. Missing tests, practitioner report counts, popularity and release age add no points. Coverage describes evidence breadth, not a probability of correctness. Scores within two points are shown as close under this policy; this is not a statistical confidence interval. When the leading scores are that close, the model measured by more evaluator families ranks first.
- 01
Gemini 4 CarbonGoogle · $2 in / $10 out per M tokens · 1.0M context
Gemini 4 Carbon ranks #1 of 148 on LMArena's long-query category (Elo 1549), based on blind human preference for longer prompts.
Best when: Its strongest result for this task is on LMArena Long Query, which measures handling long, detailed prompts.No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.
- 02
Gemini 3.7 FlashGoogle · $0.75 in / $3.75 out per M tokens · 1.0M context
Gemini 3.7 Flash scores 79.93% on LiveBench Instruction Following (#2 of 59), including paraphrasing, simplifying, story generation, and summarization.
Best when: Its strongest result for this task is on LiveBench Instruction Following, which measures following detailed instructions exactly.No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.
- 03
Gemini 4 ArgonGoogle · $2 in / $10 out per M tokens · 1.0M context
Gemini 4 Argon ranks #2 of 148 on LMArena's long-query category (Elo 1547), based on blind human preference for longer prompts.
Best when: Its strongest result for this task is on LMArena Long Query, which measures handling long, detailed prompts.No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.
- 04
Muse Spark 1.3Meta · $1.25 in / $4.25 out per M tokens · 1.0M context
Muse Spark 1.3 scores 78% on LiveBench Instruction Following (#4 of 59), including paraphrasing, simplifying, story generation, and summarization.
Best when: Its strongest result for this task is on LiveBench Instruction Following, which measures following detailed instructions exactly.No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.
- 05
Gemini 3.8 FlashGoogle · $0.83 in / $4.13 out per M tokens · 1.0M context
Gemini 3.8 Flash scores 81.41% on LiveBench Instruction Following (#1 of 59), including paraphrasing, simplifying, story generation, and summarization.
Best when: Its strongest result for this task is on LiveBench Instruction Following, which measures following detailed instructions exactly.No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.
- 06
GPT-6 AstraOpenAI · $10 in / $50 out per M tokens · 1.1M context
Excels at factual grounding with the third-best score on FACTS Grounding.
Best when: Its strongest result for this task is on FACTS Grounding, which measures staying faithful to supplied source documents.Watch out for
- Expect lower human preference scores: it ranks #30 overall, #32 on factuality, and #40 on long-query in LMArena evaluations.
- Verify instruction following: it scores 75.58% on LiveBench Instruction Following (#7 of 59), below several cheaper options.
- 07
GPT-6.1 SolOpenAI · $2 in / $10 out per M tokens · 1.1M context
Offers strong factual grounding performance with mid-tier human preference rankings, though long-query performance is weaker than its sibling.
Best when: Use for source-grounded summarization: it scores 78% on FACTS Grounding (#4 of 25).Watch out for
- Avoid for long-document tasks: it ranks #40 on LMArena's long-query category (Elo 1459), tied with its sibling but well below top performers.
- Expect weaker instruction following: it scores 74.15% on LiveBench Instruction Following (#11 of 59).
- 08
Gemini 3.5 FlashGoogle · $1.50 in / $9 out per M tokens · 1.0M context
Maintains mid-tier rankings across human preference categories with moderate instruction following scores for summarization tasks.
Best when: Use for factuality-sensitive summaries: it ranks #15 on LMArena's factuality view (Elo 1478).Watch out for
- Expect limited document task performance: it ranks #18 on LMArena's document arena (score 1462) and scores 75.6% on LiveBench Instruction Following (#6 of 59).
Frequently asked
- What is the best model for Summarization?
- Gemini 4 Carbon ranks first as of November 15, 2026. Gemini 4 Carbon ranks #1 of 148 on LMArena's long-query category (Elo 1549), based on blind human preference for longer prompts.[1]
- What is the best alternative to Gemini 4 Carbon?
- Gemini 3.7 Flash ranks second. Gemini 3.7 Flash scores 79.93% on LiveBench Instruction Following (#2 of 59), including paraphrasing, simplifying, story generation, and summarization.[2]
Sources
- 1
“Within the 148 catalog models matched to this evaluation: Ranks #1 of 148 on LMArena's long-query category (Elo 1549), based on blind human preference for longer prompts.”
LMArena long-query category · Benchmark · Nov 11, 2026 - 2
“Within the 59 catalog models matched to this evaluation: Scores 79.93% on LiveBench Instruction Following (#2 of 59), including paraphrasing, simplifying, story generation, and summarization.”
LiveBench Instruction Following · Benchmark · Oct 18, 2026 - 3
“Within the 148 catalog models matched to this evaluation: Ranks #2 of 148 on LMArena's long-query category (Elo 1547), based on blind human preference for longer prompts.”
LMArena long-query category · Benchmark · Nov 11, 2026 - 4
“Within the 59 catalog models matched to this evaluation: Scores 78% on LiveBench Instruction Following (#4 of 59), including paraphrasing, simplifying, story generation, and summarization.”
LiveBench Instruction Following · Benchmark · Oct 18, 2026 - 5
“Within the 59 catalog models matched to this evaluation: Scores 81.41% on LiveBench Instruction Following (#1 of 59), including paraphrasing, simplifying, story generation, and summarization.”
LiveBench Instruction Following · Benchmark · Oct 18, 2026 - 6
“Within the 25 catalog models matched to this evaluation: Scores 80.1% on FACTS Grounding (#3 of 25), measuring factual support against supplied source material.”
FACTS Grounding · Benchmark · Oct 24, 2026 - 7
“Within the 147 catalog models matched to this evaluation: Ranks #30 of 147 on LMArena's overall text arena (Elo 1474), based on blind human preference votes.”
LMArena text arena · Benchmark · Nov 11, 2026 - 8
“Within the 112 catalog models matched to this evaluation: Ranks #32 of 112 on LMArena's factuality text view (Elo 1466), where answers are judged for factual accuracy in blind comparison.”
LMArena text factuality · Benchmark · Nov 11, 2026 - 9
“Within the 148 catalog models matched to this evaluation: Ranks #40 of 148 on LMArena's long-query category (Elo 1459), based on blind human preference for longer prompts.”
LMArena long-query category · Benchmark · Nov 11, 2026 - 10
“Within the 59 catalog models matched to this evaluation: Scores 75.58% on LiveBench Instruction Following (#7 of 59), including paraphrasing, simplifying, story generation, and summarization.”
LiveBench Instruction Following · Benchmark · Oct 18, 2026 - 11
“Within the 25 catalog models matched to this evaluation: Scores 78% on FACTS Grounding (#4 of 25), measuring factual support against supplied source material.”
FACTS Grounding · Benchmark · Oct 24, 2026 - 12
“Within the 148 catalog models matched to this evaluation: Ranks #40 of 148 on LMArena's long-query category (Elo 1459), based on blind human preference for longer prompts.”
LMArena long-query category · Benchmark · Nov 11, 2026 - 13
“Within the 59 catalog models matched to this evaluation: Scores 74.15% on LiveBench Instruction Following (#11 of 59), including paraphrasing, simplifying, story generation, and summarization.”
LiveBench Instruction Following · Benchmark · Oct 18, 2026 - 14
“Within the 112 catalog models matched to this evaluation: Ranks #15 of 112 on LMArena's factuality text view (Elo 1478), where answers are judged for factual accuracy in blind comparison.”
LMArena text factuality · Benchmark · Nov 11, 2026 - 15
“Within the 36 catalog models matched to this evaluation: Ranks #18 of 36 on LMArena's document arena (score 1462), based on blind preference for document tasks.”
LMArena document arena · Benchmark · Nov 9, 2026 - 16
“Within the 59 catalog models matched to this evaluation: Scores 75.6% on LiveBench Instruction Following (#6 of 59), including paraphrasing, simplifying, story generation, and summarization.”
LiveBench Instruction Following · Benchmark · Oct 18, 2026
Rankings synthesized from community evidence and open benchmarks. See methodology. Not driven by vendor marketing.