RankedAGI Logo
RankedAGI
Beta
Google logo

Gemini 1.5 Pro 002

Old

Google

•

Proprietary
# 49

Released

Sep 24, 2024

# 5

Knowledge Cutoff

Sep 24

# 2

Context Length

2M

chart

Benchmarks

# 43

Code RankedAGI

45.8%

# 30

WebDev Arena

893.34

# 24

LiveCodeBench v5

42.1%

# 31

Code LMArena

1253

# 33

Code LiveBench 24.11

48.8%

# 33

GPQA Diamond

59.1%

# 35

Reason LiveBench

46.0%

# 26

ELO LMArena

1301

# 21

Math LiveBench

57.4%

# 11

MATH

86.5%

# 24

Human Eval

84.1%

# 15

Human Eval+

79.3%

# 14

NYT Connections

19.2%

# 17

MMLU Pro

75.8%

# 16

MMLU

86.0%

# 29

Halluc. Hughes

6.6%

# 7

Aidan Bench

1515

# 28

IF LiveBench

70.8%

# 32

Data LiveBench

52.3%

# 25

Lang LiveBench

43.3%

# 30

Avg LiveBench

55.5%

# 15

IF Evaluation

81.9%

coins

Pricing

# 24

Input Cost /M

$1.25

# 24

Output Cost /M

$2.5

# 13

Cached Cost /M

$0.875

sparkle-2

Additional Details

Model ID

gemini-1.5-pro-002

Last Updated

about 1 month ago