Google logo

Gemma 2

Latest

Google

Open Source

9B
# 53

Released

Jun 27, 2024

# 7

Knowledge Cutoff

Jun 24

# 9

Context Length

8K

chart

Benchmarks

# 59

Code LiveBench

22.5%

# 47

Code LMArena

1180

# 53

Reason LiveBench

15.2%

# 48

Math LiveBench

19.5%

# 45

MATH

36.6%

# 36

Human Eval

40.2%

# 47

MMLU Pro

52.1%

# 32

MMLU

71.3%

# 31

Halluc. Hughes

10.1%

# 16

Aidan Bench

859

# 50

IF LiveBench

52.6%

# 52

Data LiveBench

35.1%

# 50

Lang LiveBench

25.5%

# 56

Avg LiveBench

28.4%