Gemma 2

Latest

Google

•

Open Source

•

9B

# 65

Released

Jun 27, 2024

# 9

Knowledge Cutoff

Jun 24

# 11

Context Length

8K

Benchmarks

# 91

Code RankedAGI

22.5%

# 55

Code LMArena

1180

# 60

Code LiveBench (old)

22.5%

# 54

Reason LiveBench (old)

15.2%

# 49

Math LiveBench (old)

19.5%

# 45

MATH

36.6%

# 37

Human Eval

40.2%

# 50

MMLU Pro

52.1%

# 40

MMLU

71.3%

# 39

Halluc. Hughes

10.1%

# 16

Aidan Bench

859

# 50

IF LiveBench (old)

52.6%

# 57

Avg LiveBench (old)

28.4%