Gemini 1.5 Pro 002

Old

Google

•

Proprietary

# 56

Released

Sep 24, 2024

# 6

Knowledge Cutoff

Sep 24

# 2

Context Length

2M

Benchmarks

# 50

Code RankedAGI

45.8%

# 33

WebDev Arena

893.34

# 25

LiveCodeBench v5

42.1%

# 36

Code LMArena

1253

# 33

Code LiveBench (old)

48.8%

# 42

GPQA Diamond

59.1%

# 35

Reason LiveBench (old)

46.0%

# 33

ELO LMArena

1301

# 21

Math LiveBench (old)

57.4%

# 11

MATH

86.5%

# 24

Human Eval

84.1%

# 15

Human Eval+

79.3%

# 14

NYT Connections

19.2%

# 17

MMLU Pro

75.8%

# 18

MMLU

86.0%

# 33

Halluc. Hughes

6.6%

# 7

Aidan Bench

1515

# 28

IF LiveBench (old)

70.8%

# 30

Avg LiveBench (old)

55.5%

# 16

IF Evaluation

81.9%

Pricing

# 24

Input Cost /M

$1.25

# 24

Output Cost /M

$2.5

# 15

Cached Cost /M

$0.875

Additional Details

Model ID

gemini-1.5-pro-002

Last Updated

3 months ago