Llama 3.1
LatestMeta
•
Open Source•
8B# 123
Released
Jul 23, 2024
# 17
Knowledge Cutoff
Dec 23
# 14
Context Length
128K
Benchmarks
# 205
Code RankedAGI
20.1%
# 206
Agentic RankedAGI
18.8%
# 49
Code LMArena
1174
# 61
Code LiveBench (old)
19.7%
# 200
Reason RankedAGI
27.3%
# 117
GPQA Diamond
27.0%
# 92
Text Arena
1171
# 33
Human Eval
72.6%
# 21
Human Eval+
62.8%
# 68
MMLU Pro
44.3%
# 42
MMLU
71.0%
# 31
Halluc. Hughes
5.4%
# 19
Quality Artificial Analysis
53
# 204
Math RankedAGI
37.0%
# 205
RAGI RankedAGI
31.5%
Pricing
# 18
Input Cost /M
$0.3
# 17
Output Cost /M
$0.6