Gemini 1.5 Pro 002
Old•
Proprietary# 101
Released
Sep 24, 2024
# 11
Knowledge Cutoff
Sep 24
# 2
Context Length
2M
Benchmarks
# 96
Code RankedAGI
36.9%
# 68
Code Arena
893.34
# 27
LiveCodeBench v5
42.1%
# 36
Code LMArena
1253
# 33
Code LiveBench (old)
48.8%
# 129
Reason RankedAGI
44.6%
# 82
GPQA Diamond
59.1%
# 42
Text Arena
1301
# 24
Human Eval
84.1%
# 15
Human Eval+
79.3%
# 23
NYT Connections
19.2%
# 33
MMLU Pro
75.8%
# 23
MMLU
86.0%
# 36
Halluc. Hughes
6.6%
# 7
Aidan Bench
1515
# 30
Avg LiveBench (old)
55.5%
# 22
IF Evaluation
81.9%
# 32
Data LiveBench
52.3%
# 25
Language LiveBench
43.3%
# 5
Quality Artificial Analysis
80
# 142
RAGI RankedAGI
46.4%
Pricing
# 30
Input Cost /M
$1.25
# 28
Output Cost /M
$2.5
# 27
Cached Cost /M
$0.875
Additional Details
Model ID
gemini-1.5-pro-002
Last Updated
about 1 year ago