Gemma 2
Latest•
Open Source•
27B# 93
Released
Jun 27, 2024
# 12
Knowledge Cutoff
Jun 24
# 15
Context Length
8K
Benchmarks
# 139
Code RankedAGI
12.0%
# 51
Code LMArena
1203
# 52
Code LiveBench (old)
35.9%
# 146
Reason RankedAGI
25.2%
# 48
Reason LiveBench (old)
28.1%
# 56
Text Arena
1220
# 36
Human Eval
51.8%
# 33
NYT Connections
12.2%
# 58
MMLU Pro
56.5%
# 44
MMLU
75.2%
# 12
Aidan Bench
1028
# 53
Avg LiveBench (old)
37.4%
# 48
Data LiveBench
43.6%
# 45
Language LiveBench
32.6%
# 166
RAGI Overall
37.3%
Additional Details
Model ID
gemma-2-27b-it
Last Updated
about 1 year ago