Gemma 2
Latest•
Open Source•
27B# 126
Released
Jun 27, 2024
# 14
Knowledge Cutoff
Jun 24
# 16
Context Length
8K
Benchmarks
# 181
Code RankedAGI
30.7%
# 137
Agentic RankedAGI
37.4%
# 44
Code LMArena
1203
# 49
Code LiveBench (old)
35.9%
# 188
Reason RankedAGI
31.9%
# 87
Text Arena
1220
# 36
Human Eval
51.8%
# 32
NYT Connections
12.2%
# 64
MMLU Pro
56.5%
# 38
MMLU
75.2%
# 12
Aidan Bench
1028
# 50
Avg LiveBench (old)
37.4%
# 45
Data LiveBench
43.6%
# 42
Language LiveBench
32.6%
# 126
Math RankedAGI
52.2%
# 168
RAGI RankedAGI
39.6%
Additional Details
Model ID
gemma-2-27b-it
Last Updated
about 1 year ago