Gemini 1.5 Pro 002
Old•
Proprietary# 42
Released
Sep 24, 2024
# 4
Knowledge Cutoff
Sep 24
# 1
Context Length
2M
Benchmarks
# 32
Code LiveBench
48.8%
# 21
WebDev Arena
893.34
# 17
LiveCodeBench v5
42.1%
# 28
Code LMArena
1253
# 28
GPQA Diamond
59.1%
# 34
Reason LiveBench
46.0%
# 25
ELO LMArena
1301
# 20
Math LiveBench
57.4%
# 11
MATH
86.5%
# 23
Human Eval
84.1%
# 15
Human Eval+
79.3%
# 14
NYT Connections
19.2%
# 13
Aider Old
66.9%
# 14
MMLU Pro
75.8%
# 14
MMLU
86.0%
# 27
Halluc. Hughes
6.6%
# 7
Aidan Bench
1515
# 28
IF LiveBench
70.8%
# 32
Data LiveBench
52.3%
# 24
Lang LiveBench
43.3%
# 29
Avg LiveBench
55.5%
# 12
IF Evaluation
81.9%
Pricing
# 23
Input Cost /M
$1.25
# 20
Output Cost /M
$2.5
# 11
Cached Cost /M
$0.875
Additional Details
Model ID
gemini-1.5-pro-002
Last Updated
3 days ago