Gemini 1.5 Pro 002
Old•
Proprietary# 114
Released
Sep 24, 2024
# 11
Knowledge Cutoff
Sep 24
# 2
Context Length
2M
Benchmarks
# 166
Code RankedAGI
33.2%
# 158
Agentic RankedAGI
32.3%
# 24
LiveCodeBench v5
42.1%
# 29
Code LMArena
1253
# 30
Code LiveBench (old)
48.8%
# 135
Reason RankedAGI
40.8%
# 77
GPQA Diamond
59.1%
# 68
Text Arena
1301
# 24
Human Eval
84.1%
# 15
Human Eval+
79.3%
# 21
NYT Connections
19.2%
# 31
MMLU Pro
75.8%
# 20
MMLU
86.0%
# 35
Halluc. Hughes
6.6%
# 7
Aidan Bench
1515
# 27
Avg LiveBench (old)
55.5%
# 19
IF Evaluation
81.9%
# 29
Data LiveBench
52.3%
# 23
Language LiveBench
43.3%
# 5
Quality Artificial Analysis
80
# 143
Math RankedAGI
49.0%
# 151
RAGI RankedAGI
40.8%
Pricing
# 32
Input Cost /M
$1.25
# 31
Output Cost /M
$2.5
# 30
Cached Cost /M
$0.88
Additional Details
Model ID
gemini-1.5-pro-002
Last Updated
about 2 months ago