Skip to content

Gemini 1.5 Pro (Sept 2024)

ModelActive
by Google · family “gemini-pro-sept”
Epoch Capabilities Index
131.7 #147 of 268
90% CI 126.4 – 133.3
Released
24 Sep 2024
Context window
Unknown
Max output
Unknown
Input $ / 1M tokens
Unknown
Output $ / 1M tokens
Unknown
Cached input $ / 1M
Unknown
Each benchmark shown separately with its own source

Benchmark results (12)

BenchmarkDomainScorevs best recordedSettingRunSource
DTBenchreasoning59.0%
60%
——External ↗
CadEvalcoding34.0%
46%
——External ↗
ARC-AGI-2reasoning0.8%
1%
——External ↗
HLEknowledge4.6%
8%
——External ↗
WeirdMLcoding22.2% ±0.0
24%
——External ↗
OTIS Mock AIME 2024-2025math23.1% ±5.2
23%
—25 Feb 2025Eval log ↗
The Agent Companyagents3.4%
8%
——External ↗
Balroggames21.0%
31%
——External ↗
SimpleBenchreasoning27.1%
33%
——External ↗
GPQA diamondscience57.2% ±2.8
60%
—27 Jan 2025Eval log ↗
MATH level 5math70.4% ±1.0
72%
—27 Jan 2025Epoch ↗
MMLUknowledge86.9%
99%
——External ↗

Source: Epoch AI Benchmarking Hub (CC BY 4.0). “External” rows are leaderboard results Epoch collects from third parties. Best reported setting per benchmark is shown.

API list price over time

Price history

$ per 1M tokens
This model has no public API price listing

0 recorded prices on — (OpenRouter listing); re-read on every data refresh, most recently 8h ago. Steps show when the price changed.

Events

No events recorded yet.