Llama 3.1-405B
ModelOpen sourceActiveby Meta · family “llamab”
Epoch Capabilities Index
128.8 #161 of 268
90% CI 123.0 – 130.8
Released
23 Jul 2024
Context window
Unknown
Max output
Unknown
Input $ / 1M tokens
Unknown
Output $ / 1M tokens
Unknown
Cached input $ / 1M
Unknown
Each benchmark shown separately with its own source
Benchmark results (15)
| Benchmark | Domain | Score | vs best recorded | Setting | Run | Source |
|---|---|---|---|---|---|---|
| DTBench | reasoning | 61.4% | 62% | — | — | External ↗ |
| WeirdML | coding | 21.4% ±0.0 | 23% | — | — | External ↗ |
| OTIS Mock AIME 2024-2025 | math | 9.7% ±3.2 | 10% | — | 25 Feb 2025 | Eval log ↗ |
| The Agent Company | agents | 7.4% | 17% | — | — | External ↗ |
| SimpleBench | reasoning | 23.0% | 28% | — | — | External ↗ |
| Cybench | coding | 7.5% | 8% | — | — | External ↗ |
| GPQA diamond | science | 50.9% ±2.6 | 53% | — | 27 Jan 2025 | Eval log ↗ |
| BBH | reasoning | 82.9% | 93% | — | — | External ↗ |
| MATH level 5 | math | 49.8% ±1.2 | 51% | — | 27 Jan 2025 | Epoch ↗ |
| MMLU | knowledge | 84.5% | 96% | — | — | External ↗ |
| PIQA | other | 85.9% | 97% | — | — | External ↗ |
| Winogrande | other | 89.2% | 100% | — | — | External ↗ |
| HellaSwag | reasoning | 89.2% | 94% | — | — | External ↗ |
| ARC AI2 | other | 95.3% | 100% | — | — | External ↗ |
| TriviaQA | other | 82.7% | 94% | — | — | External ↗ |
Source: Epoch AI Benchmarking Hub (CC BY 4.0). “External” rows are leaderboard results Epoch collects from third parties. Best reported setting per benchmark is shown.
API list price over time
Price history
$ per 1M tokens
This model has no public API price listing
0 recorded prices on — (OpenRouter listing); re-read on every data refresh, most recently 9h ago. Steps show when the price changed.
Events
No events recorded yet.