Gemma 2

Latest

Google

•

Open Source

•

27B

# 65

Released

Jun 27, 2024

# 9

Knowledge Cutoff

Jun 24

# 11

Context Length

8K

Benchmarks

# 72

Code RankedAGI

35.9%

# 51

Code LMArena

1203

# 52

Code LiveBench (old)

35.9%

# 48

Reason LiveBench (old)

28.1%

# 53

ELO LMArena

1220

# 47

Math LiveBench (old)

26.2%

# 42

MATH

42.3%

# 36

Human Eval

51.8%

# 25

NYT Connections

12.2%

# 48

MMLU Pro

56.5%

# 37

MMLU

75.2%

# 12

Aidan Bench

1028

# 47

IF LiveBench (old)

58.1%

# 53

Avg LiveBench (old)

37.4%

Additional Details

Model ID

gemma-2-27b-it

Last Updated

3 months ago