Google logo

Gemini 1.5 Pro 002

Old

Google

Proprietary
# 42

Released

Sep 24, 2024

# 4

Knowledge Cutoff

Sep 24

# 1

Context Length

2M

chart

Benchmarks

# 32

Code LiveBench

48.8%

# 21

WebDev Arena

893.34

# 17

LiveCodeBench v5

42.1%

# 28

Code LMArena

1253

# 28

GPQA Diamond

59.1%

# 34

Reason LiveBench

46.0%

# 25

ELO LMArena

1301

# 20

Math LiveBench

57.4%

# 11

MATH

86.5%

# 23

Human Eval

84.1%

# 15

Human Eval+

79.3%

# 14

NYT Connections

19.2%

# 13

Aider Old

66.9%

# 14

MMLU Pro

75.8%

# 14

MMLU

86.0%

# 27

Halluc. Hughes

6.6%

# 7

Aidan Bench

1515

# 28

IF LiveBench

70.8%

# 32

Data LiveBench

52.3%

# 24

Lang LiveBench

43.3%

# 29

Avg LiveBench

55.5%

# 12

IF Evaluation

81.9%

coins

Pricing

# 23

Input Cost /M

$1.25

# 20

Output Cost /M

$2.5

# 11

Cached Cost /M

$0.875

sparkle-2

Additional Details

Model ID

gemini-1.5-pro-002

Last Updated

3 days ago