Gemma 2

Latest

Google

•

Open Source

•

27B

# 53

Released

Jun 27, 2024

# 7

Knowledge Cutoff

Jun 24

# 9

Context Length

8K

Benchmarks

# 51

Code LiveBench

35.9%

# 43

Code LMArena

1203

# 47

Reason LiveBench

28.1%

# 46

ELO LMArena

1220

# 46

Math LiveBench

26.2%

# 42

MATH

42.3%

# 35

Human Eval

51.8%

# 25

NYT Connections

12.2%

# 45

MMLU Pro

56.5%

# 29

MMLU

75.2%

# 12

Aidan Bench

1028

# 47

IF LiveBench

58.1%

# 48

Data LiveBench

43.6%

# 44

Lang LiveBench

32.6%

# 52

Avg LiveBench

37.4%

Additional Details

Model ID

gemma-2-27b-it

Last Updated

3 days ago