Llama 3.1
LatestMeta
•
Open Source•
8B# 77
Released
Jul 23, 2024
# 13
Knowledge Cutoff
Dec 23
# 11
Context Length
128K
Benchmarks
# 117
Code RankedAGI
19.7%
# 56
Code LMArena
1174
# 64
Code LiveBench (old)
19.7%
# 91
GPQA Diamond
27.0%
# 53
Reason LiveBench (old)
15.3%
# 59
ELO LMArena
1171
# 51
Math LiveBench (old)
16.6%
# 34
MATH
64.0%
# 33
Human Eval
72.6%
# 21
Human Eval+
62.8%
# 59
MMLU Pro
44.3%
# 48
MMLU
71.0%
# 30
Halluc. Hughes
5.4%
Pricing
# 16
Input Cost /M
$0.3
# 16
Output Cost /M
$0.6