Source: Epoch AI (CC BY 4.0). ECI is Epoch's item-response model over many benchmarks; each model page shows its 90% confidence interval.
Only models with both an ECI score and an OpenRouter price. Normalisation: 75% input + 25% output price. Click a point to open the model.
| # | Model | ECI ↑ | Context | In $/M | Weights | Released |
|---|---|---|---|---|---|---|
| 601 | Llama 3.2 3B Instruct | — | 131K | $0.050 | Open source | 25 Sep 2024 |
| 602 | Llama 3.2 11B | — | — | — | Open source | 24 Sep 2024 |
| 603 | Llama 3.2 3B | — | — | — | Open source | 24 Sep 2024 |
| 604 | Qwen2.5 72B Instruct | — | 33K | $0.36 | Open source | 19 Sep 2024 |
| 605 | Qwen2.5-14B | — | — | — | Open source | 19 Sep 2024 |
| 606 | Pixtral 12B | — | — | — | Open source | 17 Sep 2024 |
| 607 | Mistral Small v24.09 | — | — | — | Open source | 17 Sep 2024 |
| 608 | DeepSeek-V2.5 (Sep 2024) | — | — | — | Open source | 6 Sep 2024 |
| 609 | Command R (08-2024) | — | 128K | $0.15 | ? | 30 Aug 2024 |
| 610 | c4ai-command-r-08-2024 | — | — | — | ? | 30 Aug 2024 |
| 611 | Qwen2-VL-72B-Instruct | — | — | — | ? | 29 Aug 2024 |
| 612 | Qwen2-VL-7B-Instruct | — | — | — | ? | 29 Aug 2024 |
| 613 | Llama 3.1 Euryale 70B v2.2 | — | 131K | $0.85 | Open source | 28 Aug 2024 |
| 614 | Hermes 3 70B Instruct | — | 131K | $0.70 | Open source | 18 Aug 2024 |
| 615 | Phi-3.5-MoE | — | — | — | Open source | 17 Aug 2024 |
| 616 | Hermes 3 405B Instruct | — | 131K | $1.00 | Open source | 16 Aug 2024 |
| 617 | Phi-3.5-mini | — | — | — | Open source | 16 Aug 2024 |
| 618 | Phi-3.5-vision-instruct | — | — | — | ? | 16 Aug 2024 |
| 619 | InternVL-Chat-ViT-6B-Vicuna-13B | — | — | — | ? | 16 Aug 2024 |
| 620 | Llama 3 8B Lunaris | — | 8K | $0.040 | Open source | 13 Aug 2024 |
| 621 | GPT-4o (2024-08-06) | — | 128K | $2.50 | ? | 6 Aug 2024 |
| 622 | Llama 3.1 8B Instruct | — | 131K | $0.050 | Open source | 23 Jul 2024 |
| 623 | Llama 3.1 70B Instruct | — | 131K | $0.40 | Open source | 23 Jul 2024 |
| 624 | GPT-4o-mini (2024-07-18) | — | 128K | $0.15 | ? | 18 Jul 2024 |
| 625 | Claude 3.5 Sonnet (Jun 2024) | — | — | — | Closed | 20 Jun 2024 |
| 626 | Hermes 2 Theta Llama-3 70B | — | — | — | Open source | 20 Jun 2024 |
| 627 | DeepSeek-Coder-V2 236B | — | — | — | Open source | 17 Jun 2024 |
| 628 | DeepSeek-Coder-V2-Lite-Instruct | — | — | — | ? | 13 Jun 2024 |
| 629 | falcon-11B-vlm | — | — | — | ? | 21 May 2024 |
| 630 | GPT-4o | — | 128K | $2.50 | ? | 13 May 2024 |
| 631 | GPT-4o (2024-05-13) | — | 128K | $5.00 | ? | 13 May 2024 |
| 632 | Yi-1.5-34B 01.AI | — | — | — | Open source | 13 May 2024 |
| 633 | Yi-Large 01.AI | — | — | — | Closed | 13 May 2024 |
| 634 | llama3-llava-next-8b | — | — | — | ? | 20 Apr 2024 |
| 635 | Mixtral 8x22B Instruct | — | 66K | $2.00 | Open source | 17 Apr 2024 |
| 636 | WizardLM-2 8x22B | — | 66K | $0.62 | Open source | 16 Apr 2024 |
| 637 | GPT-4 Turbo | — | 128K | $10.0 | ? | 9 Apr 2024 |
| 638 | Qwen1.5-32B | — | — | — | Open source | 3 Apr 2024 |
| 639 | DBRX Databricks | — | — | — | Open source | 27 Mar 2024 |
| 640 | openhands-lm-32b-v0.1 | — | — | — | ? | 26 Mar 2024 |
| 641 | MM1-3B-Chat | — | — | — | ? | 14 Mar 2024 |
| 642 | MM1-7B-Chat | — | — | — | ? | 14 Mar 2024 |
| 643 | mistral-small-2402 | — | — | — | ? | 26 Feb 2024 |
| 644 | Gemini 1.5 Pro (Feb 2024) | — | — | — | Closed | 15 Feb 2024 |
| 645 | Qwen1.5-72B | — | — | — | Open source | 4 Feb 2024 |
| 646 | Qwen1.5-7B | — | — | — | Open source | 4 Feb 2024 |
| 647 | Qwen1.5-14B | — | — | — | Open source | 4 Feb 2024 |
| 648 | llava-v1.6-vicuna-7b | — | — | — | ? | 31 Jan 2024 |
| 649 | llava-v1.6-vicuna-13b | — | — | — | ? | 31 Jan 2024 |
| 650 | llava-v1.6-mistral-7b | — | — | — | ? | 31 Jan 2024 |
| 651 | GPT-3.5 Turbo (older v0613) | — | 4K | $1.00 | ? | 25 Jan 2024 |
| 652 | GPT-4 Turbo Preview (January 2024) | — | — | — | Closed | 25 Jan 2024 |
| 653 | Gemini 1.0 Pro Vision | — | — | — | Closed | 4 Jan 2024 |
| 654 | instructblip-vicuna-13b | — | — | — | ? | 25 Dec 2023 |
| 655 | InternVL-Chat-ViT-6B-Vicuna-7B | — | — | — | ? | 25 Dec 2023 |
| 656 | Mistral 7B v0.2 | — | — | — | Open source | 11 Dec 2023 |
| 657 | Mistral Medium | — | — | — | Closed | 11 Dec 2023 |
| 658 | GPT-4 Turbo Preview (Nov 2023) | — | — | — | Closed | 6 Nov 2023 |
| 659 | llava-v1.5-7b | — | — | — | ? | 5 Oct 2023 |
| 660 | GPT-3.5 Turbo Instruct | — | 4K | $1.50 | ? | 28 Sep 2023 |
| 661 | internlm-chat-20b | — | — | — | ? | 17 Sep 2023 |
| 662 | Baichuan2-13B-Chat | — | — | — | ? | 6 Sep 2023 |
| 663 | GPT-3.5 Turbo 16k | — | 16K | $3.00 | ? | 28 Aug 2023 |
| 664 | Qwen-VL-Chat | — | — | — | ? | 20 Aug 2023 |
| 665 | Weaver (alpha) | — | 8K | $0.40 | ? | 2 Aug 2023 |
| 666 | ReMM SLERP 13B | — | 6K | $0.35 | Open source | 22 Jul 2023 |
| 667 | Baichuan 1-13B Baichuan | — | — | — | Open source | 11 Jul 2023 |
| 668 | MythoMax 13B | — | 8K | $0.080 | Open source | 2 Jul 2023 |
| 669 | Inflection-1 | — | — | — | Closed | 22 Jun 2023 |
| 670 | Vicuna-13B-v1.3 Large Model Systems Organization,University of California (UC) Berkeley | — | — | — | Open source | 18 Jun 2023 |
| 671 | GPT-3.5 Turbo (June 2023) | — | — | — | Closed | 13 Jun 2023 |
| 672 | GPT-4 | — | 8K | $30.0 | ? | 28 May 2023 |
| 673 | GPT-3.5 Turbo | — | 16K | $0.50 | ? | 28 May 2023 |
| 674 | instructblip-vicuna-7b | — | — | — | ? | 22 May 2023 |
| 675 | Claude 1.3 | — | — | — | Closed | 18 Apr 2023 |
| 676 | BLIP-2 (Q-Former) Salesforce Research | — | — | — | Open source | 6 Feb 2023 |