Gemma 2
Latest•
Open Source•
27B# 60
Released
Jun 27, 2024
# 8
Knowledge Cutoff
Jun 24
# 11
Context Length
8K
Benchmarks
# 67
Code RankedAGI
35.9%
# 46
Code LMArena
1203
# 52
Code LiveBench 24.11
35.9%
# 48
Reason LiveBench
28.1%
# 48
ELO LMArena
1220
# 47
Math LiveBench
26.2%
# 42
MATH
42.3%
# 36
Human Eval
51.8%
# 25
NYT Connections
12.2%
# 49
MMLU Pro
56.5%
# 34
MMLU
75.2%
# 12
Aidan Bench
1028
# 47
IF LiveBench
58.1%
# 48
Data LiveBench
43.6%
# 45
Lang LiveBench
32.6%
# 53
Avg LiveBench
37.4%
Additional Details
Model ID
gemma-2-27b-it
Last Updated
about 1 month ago