Model intelligence
676 AI models
Capability (Epoch Capabilities Index and individual benchmarks from Epoch AI), API list prices and context windows (OpenRouter), release dates and open-weight status. Benchmarks are shown individually - never merged into one invented score.
Epoch Capabilities Index by release date
Capability frontier
Source: Epoch AI (CC BY 4.0). ECI is Epoch's item-response model over many benchmarks; each model page shows its 90% confidence interval.
Blended $/1M tokens (3:1 input:output) vs ECI
Price vs capability
Only models with both an ECI score and an OpenRouter price. Normalisation: 75% input + 25% output price. Click a point to open the model.
| # | Model | ECI ↑ | Context | In $/M | Weights | Released |
|---|---|---|---|---|---|---|
| 1 | stablelm-tuned-alpha-7b | 54.3 | — | — | Closed | 19 Apr 2023 |
| 2 | DeepSeek Coder 1.3B | 62.2 | — | — | Open source | 2 Nov 2023 |
| 3 | Cerebras-GPT-13B | 82.4 | — | — | Open source | 20 Mar 2023 |
| 4 | Qwen2.5-Coder-0.5B | 87.4 | — | — | Closed | 18 Sep 2024 |
| 5 | StarCoder 2 3B | 88.0 | — | — | Open source | 22 Feb 2024 |
| 6 | DeepSeek Coder 6.7B | 88.9 | — | — | Open source | 2 Nov 2023 |
| 7 | Dolly 2.0-12b Databricks | 88.9 | — | — | Open source | 11 Apr 2023 |
| 8 | RedPajama-INCITE-7B-Base | 89.7 | — | — | Closed | 4 May 2023 |
| 9 | Baichuan1-7B Baichuan | 89.8 | — | — | Open source | 1 Jun 2023 |
| 10 | Phi-1.5 | 90.8 | — | — | Open source | 11 Sep 2023 |
| 11 | open_llama_7b | 91.0 | — | — | Closed | 7 Jun 2023 |
| 12 | Qwen-1_8B | 92.3 | — | — | Closed | 30 Nov 2023 |
| 13 | XGen-7B Salesforce | 92.8 | — | — | Open source | 27 Jun 2023 |
| 14 | StarCoder 2 7B | 92.9 | — | — | Open source | 20 Feb 2024 |
| 15 | Gemma 2B | 93.6 | — | — | Open source | 21 Feb 2024 |
| 16 | MPT-7B MosaicML | 94.0 | — | — | Open source | 5 May 2023 |
| 17 | vicuna-13b-v1.1 | 94.0 | — | — | Closed | 12 Apr 2023 |
| 18 | CodeQwen1.5-7B | 94.2 | — | — | Closed | 15 Apr 2024 |
| 19 | Falcon-7B | 94.5 | — | — | Open source | 24 Apr 2023 |
| 20 | DeepSeek Coder 33B | 95.7 | — | — | Open source | 2 Nov 2023 |
| 21 | Baichuan 2-7B Baichuan | 95.8 | — | — | Open source | 20 Sep 2023 |
| 22 | LLaMA-7B | 96.1 | — | — | Open source | 24 Feb 2023 |
| 23 | chatglm2-6b | 98.4 | — | — | Closed | 24 Jun 2023 |
| 24 | Llama 2-7B | 98.5 | — | — | Open source | 18 Jul 2023 |
| 25 | LLaMA-13B | 100.1 | — | — | Open source | 24 Feb 2023 |
| 26 | MPT-30B MosaicML | 100.2 | — | — | Open source | 22 Jun 2023 |
| 27 | INTELLECT-1 Prime Intellect,Hugging Face,Arcee AI | 100.4 | — | — | Closed | 29 Nov 2024 |
| 28 | Llama 3.2 1B | 102.0 | — | — | Open source | 24 Sep 2024 |
| 29 | internlm-7b | 102.4 | — | — | Closed | 5 Jul 2023 |
| 30 | Qwen2.5-Coder (1.5B) | 102.6 | — | — | Open source | 18 Sep 2024 |
| 31 | Baichuan2-13B Baichuan | 102.8 | — | — | Open source | 6 Sep 2023 |
| 32 | Falcon-40B | 104.0 | — | — | Open source | 25 May 2023 |
| 33 | Yi 6B 01.AI | 104.4 | — | — | Open source | 22 Nov 2023 |
| 34 | StarCoder 2 15B | 104.6 | — | — | Open source | 20 Feb 2024 |
| 35 | Llama 2-34B | 104.8 | — | — | Closed | 18 Jul 2023 |
| 36 | PaLM 2-S | 105.8 | — | — | Closed | 17 May 2023 |
| 37 | Llama 2-13B | 105.8 | — | — | Open source | 18 Jul 2023 |
| 38 | Qwen-7B | 106.5 | — | — | Open source | 28 Sep 2023 |
| 39 | LLaMA-33B | 107.1 | — | — | Open source | 24 Feb 2023 |
| 40 | Yi-9B | 107.3 | — | — | Closed | 1 Mar 2024 |
| 41 | Nemotron-4 15B | 107.4 | — | — | Closed | 26 Feb 2024 |
| 42 | Qwen2.5-Coder-3B | 107.4 | — | — | Closed | 18 Sep 2024 |
| 43 | Phi-2 | 107.6 | — | — | Open source | 12 Dec 2023 |
| 44 | PaLM 2-M | 108.0 | — | — | Closed | 17 May 2023 |
| 45 | DeepSeek-Coder-V2-Lite-Base | 108.6 | — | — | Closed | 13 Jun 2024 |
| 46 | Mistral 7B v0.3 | 108.7 | — | — | Open source | 27 May 2024 |
| 47 | Falcon 2 11B | 109.3 | — | — | Open source | 9 May 2024 |
| 48 | LLaMA-65B | 109.9 | — | — | Open source | 24 Feb 2023 |
| 49 | DeepSeek LLM 67B | 110.5 | — | — | Open source | 29 Nov 2023 |
| 50 | Gemma 7B | 111.7 | — | — | Open source | 21 Feb 2024 |
| 51 | internlm-20b | 111.8 | — | — | Closed | 18 Sep 2023 |
| 52 | Falcon-180B | 111.9 | — | — | Open source | 6 Sep 2023 |
| 53 | Mistral 7B v0.1 | 112.0 | — | — | Open source | 27 Sep 2023 |
| 54 | Qwen-14B | 112.8 | — | — | Open source | 24 Sep 2023 |
| 55 | Qwen2.5-Coder (7B) | 112.9 | — | — | Open source | 18 Sep 2024 |
| 56 | GPT-3.5 Turbo (Jun 2023) | 113.1 | — | — | Closed | 13 Jun 2023 |
| 57 | Llama 2-70B | 113.6 | — | — | Open source | 18 Jul 2023 |
| 58 | PaLM 2-L | 114.8 | — | — | Closed | 17 May 2023 |
| 59 | GPT-3.5 Turbo (Jan 2024) | 115.6 | — | — | Closed | 25 Jan 2024 |
| 60 | Gemma 3 4B | 116.0 | 131K | $0.050 | Open source | 12 Mar 2025 |
| 61 | Qwen2.5-Coder-14B | 116.3 | — | — | Closed | 18 Sep 2024 |
| 62 | Llama 3-8B | 116.3 | — | — | Open source | 18 Apr 2024 |
| 63 | Llama 3.1-8B | 116.5 | — | — | Open source | 23 Jul 2024 |
| 64 | Gemini 1.0 Pro | 117.0 | — | — | Closed | 13 Dec 2023 |
| 65 | Stable Beluga 2 | 117.0 | — | — | Open source | 20 Jul 2023 |
| 66 | phi-3-mini 3.8B | 117.2 | — | — | Open source | 23 Apr 2024 |
| 67 | Yi-34B 01.AI | 117.3 | — | — | Open source | 2 Nov 2023 |
| 68 | Ministral 3B | 118.1 | — | — | Closed | 16 Oct 2024 |
| 69 | Claude 3 Haiku | 118.3 | — | — | Closed | 7 Mar 2024 |
| 70 | Mixtral 8x7B | 118.4 | — | — | Open source | 11 Dec 2023 |
| 71 | Qwen2.5-7B | 118.4 | — | — | Open source | 19 Sep 2024 |
| 72 | GPT-3.5 Turbo (Nov 2023) | 118.5 | — | — | Closed | 6 Nov 2023 |
| 73 | Mistral Nemo | 118.6 | 131K | $0.019 | Open source | 18 Jul 2024 |
| 74 | Claude 2.1 | 119.2 | — | — | Closed | 21 Nov 2023 |
| 75 | Command R+ | 119.3 | — | — | Open source | 30 Aug 2024 |
| 76 | Qwen2.5-Coder-32B | 119.4 | — | — | Open source | 18 Sep 2024 |
| 77 | Gemma 2 9B | 119.8 | — | — | Open source | 24 Jun 2024 |
| 78 | Claude 2 | 120.1 | — | — | Closed | 11 Jul 2023 |
| 79 | Claude Instant | 120.2 | — | — | Closed | 9 Aug 2023 |
| 80 | Claude 3 Sonnet | 120.7 | — | — | Closed | 29 Feb 2024 |
| 81 | phi-3-medium 14B | 121.2 | — | — | Open source | 23 Apr 2024 |
| 82 | phi-3-small 7.4B | 121.8 | — | — | Open source | 23 Apr 2024 |
| 83 | Mixtral 8x22B | 122.0 | — | — | Open source | 17 Apr 2024 |
| 84 | Mistral Large | 122.0 | 128K | $2.00 | Closed | 26 Feb 2024 |
| 85 | Gemma 2 27B | 122.1 | 8K | $0.65 | Open source | 24 Jun 2024 |
| 86 | Gemini 1.5 Flash (May 2024) | 122.6 | — | — | Closed | 23 May 2024 |
| 87 | Llama 3-70B | 122.9 | — | — | Open source | 18 Apr 2024 |
| 88 | GPT-4 (Jun 2023) | 123.1 | — | — | Closed | 13 Jun 2023 |
| 89 | Gemma 3 12B | 123.5 | 131K | $0.050 | Open source | 12 Mar 2025 |
| 90 | Amazon Nova Pro | 123.8 | — | — | Closed | 3 Dec 2024 |
| 91 | DeepSeek-V2 (MoE-236B, May 2024) | 124.8 | — | — | Open source | 7 May 2024 |
| 92 | Qwen2-72B | 125.3 | — | — | Open source | 7 Jun 2024 |
| 93 | Llama 3.2 90B | 125.5 | — | — | Open source | 24 Sep 2024 |
| 94 | GPT-4 (Mar 2023) | 125.9 | — | — | Closed | 14 Mar 2023 |
| 95 | Llama 3.1-70B | 125.9 | — | — | Open source | 23 Jul 2024 |
| 96 | GPT-4 Turbo (Nov 2023) | 126.5 | — | — | Closed | 25 Jan 2024 |
| 97 | GPT-4o-mini | 126.6 | 128K | $0.15 | Closed | 18 Jul 2024 |
| 98 | Gemini 1.5 Pro (May 2024) | 126.9 | — | — | Closed | 14 May 2024 |
| 99 | Claude 3 Opus | 126.9 | — | — | Closed | 29 Feb 2024 |
| 100 | Mistral Small 3 | 127.1 | 33K | $0.050 | Open source | 30 Jan 2025 |
Showing 100 of 676. Benchmark cells are % (best reported setting). 3.8K benchmark results in total.Next →Export CSV