Gemma 2
Latest•
Open Source•
27B# 125
Released
Jun 27, 2024
# 14
Knowledge Cutoff
Jun 24
# 16
Context Length
8K
Benchmarks
# 191
Code RankedAGI
27.5%
# 170
Agentic RankedAGI
30.2%
# 44
Code LMArena
1203
# 49
Code LiveBench (old)
35.9%
# 195
Reason RankedAGI
28.9%
# 87
Text Arena
1220
# 36
Human Eval
51.8%
# 32
NYT Connections
12.2%
# 64
MMLU Pro
56.5%
# 38
MMLU
75.2%
# 12
Aidan Bench
1028
# 50
Avg LiveBench (old)
37.4%
# 45
Data LiveBench
43.6%
# 42
Language LiveBench
32.6%
# 135
Math RankedAGI
50.4%
# 187
RAGI RankedAGI
36.6%
Additional Details
Model ID
gemma-2-27b-it
Last Updated
about 1 year ago