Gemma 2
Latest•
Open Source•
27B# 53
Released
Jun 27, 2024
# 7
Knowledge Cutoff
Jun 24
# 9
Context Length
8K
Benchmarks
# 51
Code LiveBench
35.9%
# 43
Code LMArena
1203
# 47
Reason LiveBench
28.1%
# 46
ELO LMArena
1220
# 46
Math LiveBench
26.2%
# 42
MATH
42.3%
# 35
Human Eval
51.8%
# 25
NYT Connections
12.2%
# 45
MMLU Pro
56.5%
# 29
MMLU
75.2%
# 12
Aidan Bench
1028
# 47
IF LiveBench
58.1%
# 48
Data LiveBench
43.6%
# 44
Lang LiveBench
32.6%
# 52
Avg LiveBench
37.4%
Additional Details
Model ID
gemma-2-27b-it
Last Updated
3 days ago