Recommendation for Budget / High volume

Best Cheap LLM for High Volume

The best cheap LLM for high volume workloads is DeepSeek V4 Pro, which combines frontier-level performance with API pricing so low that users report processing nearly 500 million tokens for around $8. It ranks #20 on LMArena and consistently gets praised for being both capable and absurdly inexpensive. If you need something even cheaper for simpler tasks, DeepSeek V4 Flash sits at essentially the same quality tier with pricing around $0.09 per million input tokens. Chinese open-weight models have completely upended the cost equation for production workloads. GLM 5.2 delivers quality comparable to western frontier models at a fraction of the cost, though it costs roughly twice what DeepSeek charges. Tencent's Hy3 and various other Chinese providers offer similar value propositions. The key insight is that for bulk processing, routing, and classification, you can now get Opus-class performance at prices that make billion-token workloads practical.

About this recommendation

Updated
Jul 17, 2026
Evidence through
Jul 17, 2026
Sources
18
Revision
v1
  1. DeepSeek V4 Pro is the clear winner for high-volume production workloads. Users consistently highlight its combination of strong benchmark performance at Elo 1450 (#20 of 49) and genuinely minimal API costs. For classification and routing tasks, the economics work even for massive scale.

    Best when: You need the best price-to-performance ratio for bulk processing and can tolerate a slight quality gap behind the very top frontier models.

    Tips

    • Extremely cheap API pricing, with one user reporting $8 total spend for 486 million tokens (mostly cache hits).
      Source 1
      > I mean from a financial and sustainability standpoint, assuming they’re equally powerful as their proprietary counterparts. Presently they trail SOTA by about 6-12 months, not on par (average across everything they do). DeepSeek V4 Pro with Max reasoning is very affordable even if you pay per-token, this month I pushed about 486 million tokens through it (I will admit that >95% was cache hits, for agentic development pretty typical) and it cost me about 8 USD in total. Meanwhile with Opus or…
    • Ranks #20 of 49 on LMArena, placing it in competitive territory with western frontier models.
      Source 2
      Ranks #20 of 49 on LMArena's overall text arena (Elo 1450), based on blind human preference votes.
      LMArena text arenaOpen original ↗
    • Costs less than GLM 5.2 despite being larger, according to architectural analysis.
      Source 3
      I've been wondering about that. GLM-5.2 is also half the size of DeepSeek V4 Pro. (But costs roughly twice as much.) I looked into DeepSeek's architecture a little bit and the main focus was how can we save as much money as possible. They did a lot of cost cutting with the attention mechanisms. This allowed them to offer an insanely cheap price even on massive contexts, but seems to have come at the cost of performance? At least, that's my guess, when I see smaller models costing more and outpe…
    • Pay-as-you-go pricing stays competitive with $5 monthly subscriptions even when used heavily.
      Source 4
      Getting the pay-as-you-go plan from DeepSeek is also a good alternative. When motivation strikes you never get slowed down by quota, and it's cheap enough that even with mostly DeepSeek V4 Pro it's price-competitive with a $5 month subscription. Depending on how bursty your usage pattern is it might even be cheaper
    • Users report it performing similarly to Grok 4.5 at a much lower price.
      Source 5
      But very expensive compared to Deepseek v4 Pro, which performs similarly. Grok is stuck in a difficult place - not the best model at anything, and not the cheapest either. It's hard to make a case for using it on any dimension, even before you factor in the history (I'm not sure suggesting the company uses the model that refers to itself as "MechaHitler" is the way to a promotion).

    Watch out for

    • Performance may lag behind smaller, more expensive models in some benchmarks.
      Source 3
      I've been wondering about that. GLM-5.2 is also half the size of DeepSeek V4 Pro. (But costs roughly twice as much.) I looked into DeepSeek's architecture a little bit and the main focus was how can we save as much money as possible. They did a lot of cost cutting with the attention mechanisms. This allowed them to offer an insanely cheap price even on massive contexts, but seems to have come at the cost of performance? At least, that's my guess, when I see smaller models costing more and outpe…
    • Context windows can burn through token allotments quickly if not managed carefully.
      Source 6
      Not saying this is what you did, but I found out the hard way that keeping a context window open for a long time burns tokens like crazy. I had a Hermes session using DeepSeek v4 Pro via Ollama, and ate half my weekly token allotment in a couple hours, just by piling on more and more work inside the same prompt, instead of exiting out and starting a new session (or using the Hermes command to start a new session without exiting).
  2. GLM 5.2 sits in an odd middle ground for pricing, it costs roughly twice what DeepSeek V4 Pro charges, yet users call it 'dirt cheap' compared to western APIs when accessed through open-weight providers. It delivers quality that users compare favorably to Anthropic models.

    Best when: You want a balance of Chinese open-weight flexibility with quality that approaches western frontier models, and can pay a premium over DeepSeek for potentially better instruction following.

    Tips

    • Users report it appears to match the quality of Anthropic models at much lower prices.
      Source 7
      Fable is by Anthropic, and this is too expensive, GLM 5.2 is roughly the same quality at a much cheaper price. (I mantain a client with llama.cpp and 101 models across 14 companies by http)
      Source 8
      > I'd be very surprised if it wasn't more than 50% cheaper for nearly all workflows, for a very similar level of quality. If your using pure API ... providers like neuralwatt cut that cost down even more by using energy as the actual cost. So GLM 5.2 is more expensive then GLM 5.1 on their service (those thinking tokens), compared to API costs, its dirt cheap. And way more tokens then the zai subscription delivers. We are seeing a move towards more realistic pricing on actual consumption based…
    • Integrates easily with tools like OpenRouter, Hermes, and Cursor.
      Source 9
      https: openrouter.ai models you can use these in hermes, cursor, openclaw, opencode, etc with 2 lines of config that claude code will happily do for you if you ask GLM 5.2, deepseek 4 Flash and the newly released Hy3 are Opus 4.8 and Sonnet 4.6 level models at a tiny fraction of the cost. I'm on the $200 claude plan and blew through my weekly limits with Fable in a day, then ended up wasting $20 with opus 4.8 overages in an hour to finish out work in active sessions. Since then I've been using…
    • Subscription-based open-weight access can be cheaper than direct API costs.
      Source 8
      > I'd be very surprised if it wasn't more than 50% cheaper for nearly all workflows, for a very similar level of quality. If your using pure API ... providers like neuralwatt cut that cost down even more by using energy as the actual cost. So GLM 5.2 is more expensive then GLM 5.1 on their service (those thinking tokens), compared to API costs, its dirt cheap. And way more tokens then the zai subscription delivers. We are seeing a move towards more realistic pricing on actual consumption based…
    • Scores well on agentic benchmarks according to user reports.
    • Works well as part of a tiered strategy using cheaper models for 80% of tasks.
      Source 10
      The big danger here is the gradual increase in open-weight subscription costs. I use open weight subscriptions, with lower-cost models for 80% of my tasks and GLM-5.2, Qwen 3.7-Max, Kimi-K2.6 2.7-Code for the 20% that need the most intelligence. That lets me maximize the rate-limit the subscription gives (rate limits per model are literally a price-limit-per-token model). When new more expensive open weights come in, providers phase out older cheaper models. Over time we will either have to pay…
      0xbadcafebeeOpen original ↗

    Watch out for

    • Costs roughly twice as much as DeepSeek V4 Pro for similar workloads.
      Source 3
      I've been wondering about that. GLM-5.2 is also half the size of DeepSeek V4 Pro. (But costs roughly twice as much.) I looked into DeepSeek's architecture a little bit and the main focus was how can we save as much money as possible. They did a lot of cost cutting with the attention mechanisms. This allowed them to offer an insanely cheap price even on massive contexts, but seems to have come at the cost of performance? At least, that's my guess, when I see smaller models costing more and outpe…
    • Instruction following may be lower than some users expect.
    • GPT 5.6 models can result in cheaper bills due to thrifty chain-of-thought usage.
      Source 11
      Tokenzier aside, a report shared on reddit found that the GPT 5.6 (edit: 5.5) series are incredibly thrifty with CoTs, resulting in cheaper bills than GLM 5.2 (let alone Opus Fable): https: www.reddit.com r ZaiGLM s rUoG5adkPh Chattiness remains an open issue for some of the SoTA open weights & (to a lesser extent) Claude.
  3. Tencent Hy3 gets mentioned alongside DeepSeek V4 Pro and GLM 5.2 as offering Opus 4.8 and Sonnet 4.6 level quality at a tiny fraction of the cost. It priced out at around $3,892 for a comparison workload versus over $82,000 for Claude Opus 4.8.

    Best when: You want another Chinese open-weight option alongside DeepSeek for redundancy or A/B testing at scale.

    Tips

    • Delivers Opus 4.8 and Sonnet 4.6 level performance at a fraction of western API costs.
      Source 9
      https: openrouter.ai models you can use these in hermes, cursor, openclaw, opencode, etc with 2 lines of config that claude code will happily do for you if you ask GLM 5.2, deepseek 4 Flash and the newly released Hy3 are Opus 4.8 and Sonnet 4.6 level models at a tiny fraction of the cost. I'm on the $200 claude plan and blew through my weekly limits with Fable in a day, then ended up wasting $20 with opus 4.8 overages in an hour to finish out work in active sessions. Since then I've been using…
    • Total cost for a sample workload came in far below GLM 5.2 and dramatically below Claude and GPT.
      Source 12
      > I suspect Claude might be faster and therefore cheaper, but maybe not by a lot. While Jarred used Mythos-class model, some open weights, if they were as capable (certainly, GLM 5.2 looks the part), would have been way, way cheaper than professionals. Approx costs: DeepSeek v4 Pro & Mimo v2.5 Pro $3,426 ($2,567 $600 $259) Tencent HY3 $3,892 ($1,180 $552 $2,160) GLM 5.2 $30,016 ($8,260 $3,036 $18,720) Qwen 3.7 Max $37,925 ($14,750 $5,175 $18,000) Claude Opus 4.8 & GPT 5.5 xhigh $82,750 ($29,500…
    • Available through OpenRouter with simple configuration.
      Source 9
      https: openrouter.ai models you can use these in hermes, cursor, openclaw, opencode, etc with 2 lines of config that claude code will happily do for you if you ask GLM 5.2, deepseek 4 Flash and the newly released Hy3 are Opus 4.8 and Sonnet 4.6 level models at a tiny fraction of the cost. I'm on the $200 claude plan and blew through my weekly limits with Fable in a day, then ended up wasting $20 with opus 4.8 overages in an hour to finish out work in active sessions. Since then I've been using…

    Watch out for

    • Still costs more than DeepSeek V4 Pro for similar workloads in direct comparisons.
      Source 12
      > I suspect Claude might be faster and therefore cheaper, but maybe not by a lot. While Jarred used Mythos-class model, some open weights, if they were as capable (certainly, GLM 5.2 looks the part), would have been way, way cheaper than professionals. Approx costs: DeepSeek v4 Pro & Mimo v2.5 Pro $3,426 ($2,567 $600 $259) Tencent HY3 $3,892 ($1,180 $552 $2,160) GLM 5.2 $30,016 ($8,260 $3,036 $18,720) Qwen 3.7 Max $37,925 ($14,750 $5,175 $18,000) Claude Opus 4.8 & GPT 5.5 xhigh $82,750 ($29,500…
  4. Kimi K3 ranks impressively at #8 of 49 on LMArena (Elo 1473), outperforming most competitors on quality. However, pricing at $3/$15 per million tokens places it far above other Chinese models, matching Anthropic's Sonnet series at 1:1 parity. It's cheap relative to western labs but expensive for a Chinese open-weight model.

    Best when: Quality matters more than absolute cost optimization, and you want LMArena top-10 performance without paying Anthropic prices.

    Tips

    • Ranks #8 of 49 on LMArena with Elo 1473, beating most competitors on quality.
      Source 13
      Ranks #14 of 17 on LMArena's overall text arena (Elo 1483), based on blind human preference votes.
      LMArena text arenaOpen original ↗
    • Cost per task around $0.94, similar to GPT 5.6 Sol Max.
    • Competitive with current frontier models, trailing only Fable and Sol.
    • Scores well on agentic benchmarks.

    Watch out for

    • At $3/$15 per million tokens, it's extremely expensive for a Chinese model, matching Sonnet pricing.
    • Instruction following reported as lower than desired.
    • GLM 5.2 Max costs roughly half as much per task.
  5. Grok 4.5 ranks #19 on LMArena at Elo 1452, essentially tied with DeepSeek V4 Pro. But where DeepSeek wins on price, Grok sits in an awkward middle ground. Users say it is not the best at anything and not the cheapest either.

    Best when: You have specific reasons to use xAI's ecosystem and need Elo 1450-ish performance without western lab pricing.

    Tips

    • Ranks #19 of 49 on LMArena, competitive with DeepSeek V4 Pro.
      Source 14
      Ranks #16 of 17 on LMArena's overall text arena (Elo 1476), based on blind human preference votes.
      LMArena text arenaOpen original ↗
    • 4x better reasoning efficiency than Opus while priced at $2/$6.
      Source 15
      It seems to be extremely economical - 4x better reasoning efficiency compared to Opus while being priced at $2 $6. For comparison, GPT 5.4 is $2.5 $15, GPT 5.5 5.6 are $5 $30, Opus 4.8 is $5 $25, Fable is $10 $50. And by benchmarks (unless they gamed them), seems to be at around Opus 4.7 level, which is what Elon mentioned in https: x.com elonmusk status 2074911038286295049. I guess the Cursor data was very useful.
    • Benchmark performance around Opus 4.7 level according to Elon Musk.
      Source 15
      It seems to be extremely economical - 4x better reasoning efficiency compared to Opus while being priced at $2 $6. For comparison, GPT 5.4 is $2.5 $15, GPT 5.5 5.6 are $5 $30, Opus 4.8 is $5 $25, Fable is $10 $50. And by benchmarks (unless they gamed them), seems to be at around Opus 4.7 level, which is what Elon mentioned in https: x.com elonmusk status 2074911038286295049. I guess the Cursor data was very useful.
  6. GPT-5.6 Luna is mentioned as one of the smaller, more affordable OpenAI models designed specifically to make intelligence abundant and affordable. It outperforms Fable at one-sixth the cost, making it relevant for users who need an OpenAI option for high-volume tasks.

    Best when: You want OpenAI's infrastructure and compliance posture while minimizing per-token costs for simpler bulk tasks.

    Tips

    • Outperforms Fable 5 at roughly one-sixth the cost.
      Source 16
      "On Agents’ Last Exam (opens in a new window), an evaluation of long-running professional workflows across 55 fields, GPT‑5.6 Sol sets a new high of 53.6, eclipsing Claude Fable 5 (adaptive reasoning) by 13.1 points. Even at medium reasoning, it beats Fable 5 by 11.4 points at roughly one-quarter the estimated cost. That efficiency extends to smaller models, which are essential to making intelligence more abundant and affordable: GPT‑5.6 Terra and GPT‑5.6 Luna outperform Fable 5 at around one-s…
    • Designed to make intelligence more abundant and affordable.
      Source 16
      "On Agents’ Last Exam (opens in a new window), an evaluation of long-running professional workflows across 55 fields, GPT‑5.6 Sol sets a new high of 53.6, eclipsing Claude Fable 5 (adaptive reasoning) by 13.1 points. Even at medium reasoning, it beats Fable 5 by 11.4 points at roughly one-quarter the estimated cost. That efficiency extends to smaller models, which are essential to making intelligence more abundant and affordable: GPT‑5.6 Terra and GPT‑5.6 Luna outperform Fable 5 at around one-s…
  7. Claude Sonnet 5 ranks #25 on LMArena at Elo 1442, underperforming both Chinese competitors and other western models. Users note it seems worse on price-performance than GLM 5.2, which is striking given Sonnet 5's position as Anthropic's mid-tier offering.

    Best when: You are already committed to Anthropic's ecosystem and need a cheaper alternative to Opus for high-volume tasks.

    Watch out for

    • Ranks #25 of 49 on LMArena, below all ranked Chinese competitors.
      Source 17
      Ranks #25 of 49 on LMArena's overall text arena (Elo 1442), based on blind human preference votes.
      LMArena text arenaOpen original ↗
    • Worse price-performance than GLM 5.2 according to user analysis.
      Source 18
      Wow, seems worse even on price performance than GLM 5.2, which is only 744b parameters. From the system card: "On CyberGym vulnerability discovery, Claude Sonnet 5 is less capable than Sonnet 4.6, and far less capable than Opus 4.8 and Mythos 5 As with the other evaluations in this section, these results were achieved with all safeguards turned off. When run with our default mitigations, Sonnet 5 scored a 0 on CyberGym"
    • Less capable than Sonnet 4.6 on CyberGym vulnerability discovery.
      Source 18
      Wow, seems worse even on price performance than GLM 5.2, which is only 744b parameters. From the system card: "On CyberGym vulnerability discovery, Claude Sonnet 5 is less capable than Sonnet 4.6, and far less capable than Opus 4.8 and Mythos 5 As with the other evaluations in this section, these results were achieved with all safeguards turned off. When run with our default mitigations, Sonnet 5 scored a 0 on CyberGym"

Frequently asked

How cheap is DeepSeek V4 Pro for production use?
One user processed 486 million tokens through DeepSeek V4 Pro for approximately $8 total, with over 95% being cache hits. Pay-as-you-go pricing stays competitive with $5 monthly subscriptions even at high volumes.
What's the cheapest option for bulk classification tasks?
DeepSeek V4 Flash costs roughly $0.09 per million input tokens and $0.18 per million output tokens, making it essentially free for high-volume workloads.
How do GLM 5.2 and DeepSeek V4 Pro compare on price?
GLM 5.2 is half the parameter count of DeepSeek V4 Pro but costs roughly twice as much to use, making DeepSeek the better value for cost-sensitive workloads.
Are Chinese models reliable for production workloads?
Users report running hundreds of multi-agent sessions using DeepSeek V4 Pro, Kimi, Mimo, and other Chinese models with good reliability. One user built a client integrating 101 models across 14 providers.
What's the catch with ultra-cheap API pricing?
Long context windows can burn tokens quickly if you keep sessions open. Some models trade quality for cost savings through optimized attention mechanisms, but benchmarks show they perform competitively.

Sources

  1. 1

    > I mean from a financial and sustainability standpoint, assuming they’re equally powerful as their proprietary counterparts. Presently they trail SOTA by about 6-12 months, not on par (average across everything they do). DeepSeek V4 Pro with Max reasoning is very affordable even if you pay per-token, this month I pushed about 486 million tokens through it (I will admit that >95% was cache hits, for agentic development pretty typical) and it cost me about 8 USD in total. Meanwhile with Opus or…

    KronisLV · Hacker News · Jun 23, 2026
  2. 2

    Ranks #20 of 49 on LMArena's overall text arena (Elo 1450), based on blind human preference votes.

    LMArena text arena · Benchmark · Jul 16, 2026
  3. 3

    I've been wondering about that. GLM-5.2 is also half the size of DeepSeek V4 Pro. (But costs roughly twice as much.) I looked into DeepSeek's architecture a little bit and the main focus was how can we save as much money as possible. They did a lot of cost cutting with the attention mechanisms. This allowed them to offer an insanely cheap price even on massive contexts, but seems to have come at the cost of performance? At least, that's my guess, when I see smaller models costing more and outpe…

    andai · Hacker News · Jul 9, 2026
  4. 4

    Getting the pay-as-you-go plan from DeepSeek is also a good alternative. When motivation strikes you never get slowed down by quota, and it's cheap enough that even with mostly DeepSeek V4 Pro it's price-competitive with a $5 month subscription. Depending on how bursty your usage pattern is it might even be cheaper

    wongarsu · Hacker News · Jul 7, 2026
  5. 5

    But very expensive compared to Deepseek v4 Pro, which performs similarly. Grok is stuck in a difficult place - not the best model at anything, and not the cheapest either. It's hard to make a case for using it on any dimension, even before you factor in the history (I'm not sure suggesting the company uses the model that refers to itself as "MechaHitler" is the way to a promotion).

    bashtoni · Hacker News · Jul 8, 2026
  6. 6

    Not saying this is what you did, but I found out the hard way that keeping a context window open for a long time burns tokens like crazy. I had a Hermes session using DeepSeek v4 Pro via Ollama, and ate half my weekly token allotment in a couple hours, just by piling on more and more work inside the same prompt, instead of exiting out and starting a new session (or using the Hermes command to start a new session without exiting).

    diseasedyak · Hacker News · Jul 7, 2026
  7. 7

    Fable is by Anthropic, and this is too expensive, GLM 5.2 is roughly the same quality at a much cheaper price. (I mantain a client with llama.cpp and 101 models across 14 companies by http)

    refulgentis · Hacker News · Jul 16, 2026
  8. 8

    > I'd be very surprised if it wasn't more than 50% cheaper for nearly all workflows, for a very similar level of quality. If your using pure API ... providers like neuralwatt cut that cost down even more by using energy as the actual cost. So GLM 5.2 is more expensive then GLM 5.1 on their service (those thinking tokens), compared to API costs, its dirt cheap. And way more tokens then the zai subscription delivers. We are seeing a move towards more realistic pricing on actual consumption based…

    benjiro29 · Hacker News · Jul 6, 2026
  9. 9

    https: openrouter.ai models you can use these in hermes, cursor, openclaw, opencode, etc with 2 lines of config that claude code will happily do for you if you ask GLM 5.2, deepseek 4 Flash and the newly released Hy3 are Opus 4.8 and Sonnet 4.6 level models at a tiny fraction of the cost. I'm on the $200 claude plan and blew through my weekly limits with Fable in a day, then ended up wasting $20 with opus 4.8 overages in an hour to finish out work in active sessions. Since then I've been using…

    m_ke · Hacker News · Jul 6, 2026
  10. 10

    The big danger here is the gradual increase in open-weight subscription costs. I use open weight subscriptions, with lower-cost models for 80% of my tasks and GLM-5.2, Qwen 3.7-Max, Kimi-K2.6 2.7-Code for the 20% that need the most intelligence. That lets me maximize the rate-limit the subscription gives (rate limits per model are literally a price-limit-per-token model). When new more expensive open weights come in, providers phase out older cheaper models. Over time we will either have to pay…

    0xbadcafebee · Hacker News · Jul 16, 2026
  11. 11

    Tokenzier aside, a report shared on reddit found that the GPT 5.6 (edit: 5.5) series are incredibly thrifty with CoTs, resulting in cheaper bills than GLM 5.2 (let alone Opus Fable): https: www.reddit.com r ZaiGLM s rUoG5adkPh Chattiness remains an open issue for some of the SoTA open weights & (to a lesser extent) Claude.

    ignoramous · Hacker News · Jul 13, 2026
  12. 12

    > I suspect Claude might be faster and therefore cheaper, but maybe not by a lot. While Jarred used Mythos-class model, some open weights, if they were as capable (certainly, GLM 5.2 looks the part), would have been way, way cheaper than professionals. Approx costs: DeepSeek v4 Pro & Mimo v2.5 Pro $3,426 ($2,567 $600 $259) Tencent HY3 $3,892 ($1,180 $552 $2,160) GLM 5.2 $30,016 ($8,260 $3,036 $18,720) Qwen 3.7 Max $37,925 ($14,750 $5,175 $18,000) Claude Opus 4.8 & GPT 5.5 xhigh $82,750 ($29,500…

    ignoramous · Hacker News · Jul 9, 2026
  13. 13

    Ranks #14 of 17 on LMArena's overall text arena (Elo 1483), based on blind human preference votes.

    LMArena text arena · Benchmark · Jul 20, 2026
  14. 14

    Ranks #16 of 17 on LMArena's overall text arena (Elo 1476), based on blind human preference votes.

    LMArena text arena · Benchmark · Jul 20, 2026
  15. 15

    It seems to be extremely economical - 4x better reasoning efficiency compared to Opus while being priced at $2 $6. For comparison, GPT 5.4 is $2.5 $15, GPT 5.5 5.6 are $5 $30, Opus 4.8 is $5 $25, Fable is $10 $50. And by benchmarks (unless they gamed them), seems to be at around Opus 4.7 level, which is what Elon mentioned in https: x.com elonmusk status 2074911038286295049. I guess the Cursor data was very useful.

    Tiberium · Hacker News · Jul 8, 2026
  16. 16

    "On Agents’ Last Exam (opens in a new window), an evaluation of long-running professional workflows across 55 fields, GPT‑5.6 Sol sets a new high of 53.6, eclipsing Claude Fable 5 (adaptive reasoning) by 13.1 points. Even at medium reasoning, it beats Fable 5 by 11.4 points at roughly one-quarter the estimated cost. That efficiency extends to smaller models, which are essential to making intelligence more abundant and affordable: GPT‑5.6 Terra and GPT‑5.6 Luna outperform Fable 5 at around one-s…

    saberience · Hacker News · Jul 9, 2026
  17. 17

    Ranks #25 of 49 on LMArena's overall text arena (Elo 1442), based on blind human preference votes.

    LMArena text arena · Benchmark · Jul 16, 2026
  18. 18

    Wow, seems worse even on price performance than GLM 5.2, which is only 744b parameters. From the system card: "On CyberGym vulnerability discovery, Claude Sonnet 5 is less capable than Sonnet 4.6, and far less capable than Opus 4.8 and Mythos 5 As with the other evaluations in this section, these results were achieved with all safeguards turned off. When run with our default mitigations, Sonnet 5 scored a 0 on CyberGym"

    conradkay · Hacker News · Jun 30, 2026

Rankings synthesized from community evidence and open benchmarks. See methodology. Not driven by vendor marketing.