| Benchmark | Domain | Score | vs best recorded | Setting | Run | Source |
|---|---|---|---|---|---|---|
| GSO-Bench | coding | 3.8% | 8% | — | — | External ↗ |
| CadEval | coding | 54.0% | 73% | — | — | External ↗ |
| ARC-AGI-2 | reasoning | 0.0% | 0% | — | — | External ↗ |
| METR Time Horizons | agents | 55.8% | 66% | — | — | External ↗ |
| GeoBench | multimodal | 68.0% | 77% | — | — | External ↗ |
| FrontierMath-2025-02-28-Privatesuperseded | math | 3.1% ±1.0 | 6% | — | 6 Mar 2025 | Epoch ↗ |
| Fiction.LiveBench | long-context | 50.0% | 51% | — | — | External ↗ |
| Lech Mazur Writing | other | 79.4% | 92% | — | — | External ↗ |
| VPCT | multimodal | 39.0% | 43% | — | — | External ↗ |
| Aider polyglot | coding | 60.4% | 69% | — | — | External ↗ |
| OTIS Mock AIME 2024-2025 | math | 21.9% ±4.8 | 22% | — | 25 Feb 2025 | Eval log ↗ |
| The Agent Company | agents | 30.9% | 72% | — | — | External ↗ |
| SimpleBench | reasoning | 44.9% | 55% | — | — | External ↗ |
| Cybench | coding | 20.0% | 22% | — | — | External ↗ |
| SWE-Bench verified | coding | 61.0% ±2.2 | 73% | — | 4 Feb 2026 | Eval log ↗ |
| OSWorld | agents | 35.8% | 50% | agent: claude-3-7-sonnet-20250219 (50 steps) | — | External ↗ |
| GPQA diamond | science | 66.0% ±2.7 | 69% | — | 24 Feb 2025 | Eval log ↗ |
| MATH level 5 | math | 68.2% ±1.1 | 69% | — | 24 Feb 2025 | Epoch ↗ |
| ARC-AGI | reasoning | 13.6% | 14% | — | — | External ↗ |
Source: Epoch AI Benchmarking Hub (CC BY 4.0). “External” rows are leaderboard results Epoch collects from third parties. Best reported setting per benchmark is shown.
0 observations (OpenRouter listing). History accumulates with every ingest run; a single point means no change has been observed yet.