phi-3-medium 14B
ModelOpen sourceActiveby Microsoft · family “phi-mediumb”
Epoch Capabilities Index
121.2 #188 of 268
90% CI 113.3 – 124.4
Released
23 Apr 2024
Context window
Unknown
Max output
Unknown
Input $ / 1M tokens
Unknown
Output $ / 1M tokens
Unknown
Cached input $ / 1M
Unknown
Each benchmark shown separately with its own source
Benchmark results (10)
| Benchmark | Domain | Score | vs best recorded | Setting | Run | Source |
|---|---|---|---|---|---|---|
| GPQA diamond | science | 27.6% ±1.6 | 29% | — | 31 Jan 2025 | Eval log ↗ |
| BBH | reasoning | 81.4% | 91% | — | — | External ↗ |
| MATH level 5 | math | 17.6% ±0.7 | 18% | — | 31 Jan 2025 | Epoch ↗ |
| MMLU | knowledge | 78.0% | 89% | — | — | External ↗ |
| ANLI | other | 55.8% | 96% | — | — | External ↗ |
| Winogrande | other | 81.5% | 91% | — | — | External ↗ |
| HellaSwag | reasoning | 82.4% | 86% | — | — | External ↗ |
| OpenBookQA | other | 87.4% | 99% | — | — | External ↗ |
| ARC AI2 | other | 91.6% | 96% | — | — | External ↗ |
| TriviaQA | other | 73.9% | 84% | — | — | External ↗ |
Source: Epoch AI Benchmarking Hub (CC BY 4.0). “External” rows are leaderboard results Epoch collects from third parties. Best reported setting per benchmark is shown.
API list price over time
Price history
$ per 1M tokens
No data recorded for this period
0 observations (OpenRouter listing). History accumulates with every ingest run; a single point means no change has been observed yet.
Events
No events recorded yet.