Gemma 2

Latest

Google

•

Open Source

•

9B

# 58

Released

Jun 27, 2024

# 8

Knowledge Cutoff

Jun 24

# 11

Context Length

8K

Benchmarks

# 81

Code RankedAGI

22.5%

# 50

Code LMArena

1180

# 60

Code LiveBench 24.11

22.5%

# 54

Reason LiveBench

15.2%

# 49

Math LiveBench

19.5%

# 45

MATH

36.6%

# 36

Human Eval

40.2%

# 50

MMLU Pro

52.1%

# 37

MMLU

71.3%

# 34

Halluc. Hughes

10.1%

# 16

Aidan Bench

859

# 50

IF LiveBench

52.6%

# 52

Data LiveBench

35.1%

# 51

Lang LiveBench

25.5%

# 57

Avg LiveBench

28.4%