Open-Source LLMs that rival paid models in 2026: a practical comparison
For years, the conversation about state-of-the-art large language models was dominated by closed, paid APIs: GPT, Claude and Gemini. That gap has narrowed dramatically. In the most recent Artificial Analysis Intelligence Index (v4.0), which aggregates ten independent evaluations (GDPval-AA, τ²-Bench Telecom, Terminal-Bench Hard, SciCode, AA-LCR, AA-Omniscience, IFBench, Humanity’s Last Exam, GPQA Diamond and CritPt), several open-weights models now sit only a handful of points below the best proprietary systems, and often at a fraction of the cost.
This article reviews the open-source alternatives that are closest in quality to the paid flagships today, where each one shines, and when it genuinely makes sense to replace a commercial API with a self-hosted or open-weights option.
What “open-source” really means here
In the LLM world, “open-source” is often used loosely. Most of the models discussed below are open-weights: the weights are downloadable and can be self-hosted, and many (but not all) allow commercial use. A minority are fully open (weights + training data + recipe). In this article, “open” refers to open-weights models usable at zero or near-zero cost when self-hosted, or very cheaply through third-party inference providers.
The leading open-weights contenders
According to the Intelligence Index v4.0, the top open-weights models are led by GLM-5.1 (Zhipu/Z AI) with a score of 51, followed by MiniMax-M2.7 (50) and Qwen3.5 397B A17B (Alibaba, 46). Other serious contenders include DeepSeek V3.2 (42), gpt-oss-120B from OpenAI (36), Gemma 4 31B from Google (39), Mistral Small 4 (26), NVIDIA Nemotron 3 Super (33) and Llama 4 Maverick (18) from Meta. For reference, the proprietary leaders — Claude Opus 4.7, Gemini 3.1 Pro Preview and GPT-5.4 — are tied at 57.
Comparative table: Intelligence Index
| Model | Type | Intelligence Index | Open weights | Notes |
|---|---|---|---|---|
| Claude Opus 4.7 (max) | Proprietary | 57 | ❌ | Anthropic flagship |
| Gemini 3.1 Pro Preview | Proprietary | 57 | ❌ | Google flagship |
| GPT-5.4 (xhigh) | Proprietary | 57 | ❌ | OpenAI flagship |
| GLM-5.1 | Open | 51 | ✅ | Best open model overall |
| MiniMax-M2.7 | Open | 50 | ✅ | Strong reasoning |
| Qwen3.5 397B A17B | Open | 46 | ✅ | MoE, 17B active params |
| DeepSeek V3.2 | Open | 42 | ✅ | Great quality/price ratio |
| Gemma 4 31B | Open | 39 | ✅ | Light and efficient |
| gpt-oss-120B (high) | Open | 36 | ✅ | OpenAI’s open release |
| NVIDIA Nemotron 3 Super | Open | 33 | ✅ | NVIDIA ecosystem |
| Mistral Small 4 | Open | 26 | ✅ | Small footprint |
| Llama 4 Maverick | Open | 18 | ✅ | Meta’s MoE model |
Source: Artificial Analysis Intelligence Index v4.0.
Comparative table: Price (blended, USD per 1M tokens)
| Model | Blended price (USD / 1M tok) |
|---|---|
| Claude Opus 4.7 (max) | $10.00 |
| GPT-5.4 (xhigh) | $6.00 |
| Gemini 3.1 Pro Preview | $5.60 |
| Claude Sonnet 4.6 (max) | $4.50 |
| GLM-5.1 | $2.10 |
| DeepSeek V3.2 | $0.30 |
| gpt-oss-120B (high) | $0.30 |
| NVIDIA Nemotron 3 Super | $0.40 |
DeepSeek V3.2 costs roughly 33× less than Claude Opus 4.7 while scoring 42 vs 57 on intelligence — very close to the paid flagship for many everyday tasks.
Specific strengths by use case
- Agentic / tool use (τ²-Bench Telecom): GLM-5.1 leads all models at 98%, followed by Kimi K2.5 and Qwen3.6 Max Preview (96%).
- Coding (SciCode): Qwen3.5 397B A17B reaches 89% and Gemma 4 31B hits 87%.
- Instruction following (IFBench): Qwen3.5 397B A17B scores 50%, above Claude Sonnet 4.6 (46%).
- Reasoning (GPQA Diamond): Qwen3.5 397B A17B (79%) and MiMo-V2-Pro (72%) are in the top tier.
- Hallucination control (AA-Omniscience): Proprietary models still lead here.
Context windows
| Model | Context window |
|---|---|
| Llama 4 Maverick | 10,000,000 tokens |
| Grok 4.20 (proprietary) | 2,000,000 |
| Gemini 3.1 Pro | 1,050,000 |
| Claude Opus 4.7 | 1,000,000 |
| GPT-5.4 | 400,000 |
| Qwen3.5 397B | 262,000 |
| GLM-5.1 | 200,000 |
| DeepSeek V3.2 | 131,000 |
When does open-source make sense?
- Data privacy and on-prem deployment, where sending data to OpenAI, Anthropic or Google is not an option.
- Cost at scale, where millions of tokens per day make the price gap decisive.
- Customization through fine-tuning, LoRA or full retraining for a vertical domain.
- Vendor independence, avoiding lock-in with a specific commercial provider.
Proprietary models still hold an edge in the most demanding reasoning tasks (Humanity’s Last Exam, CritPt), hallucination control and native multimodality.
Conclusion
The gap between open and closed has shrunk from “a different league” to “a handful of points in a benchmark.” Models like GLM-5.1, MiniMax-M2.7, Qwen3.5 397B and DeepSeek V3.2 today deliver 80–90% of the quality of the top paid flagships at 5–20% of the cost. For most production workloads — chatbots, summarization, coding, classification, RAG — the correct question is no longer “can open-source compete?” but rather “which open model fits my specific use case?”.
Data source: Artificial Analysis Intelligence Index v4.0, consulted in April 2026.