Llama 3.3
LatestMeta
•
Open Source•
70B# 104
Released
Dec 6, 2024
# 17
Knowledge Cutoff
Dec 23
Benchmarks
# 152
Code RankedAGI
36.1%
# 164
Agentic RankedAGI
31.2%
# 36
Code LMArena
1232
# 48
Code LiveBench (old)
36.6%
# 152
Reason RankedAGI
38.6%
# 90
GPQA Diamond
50.5%
# 78
Text Arena
1257
# 14
Human Eval
88.4%
# 2
Human Eval+
87.6%
# 29
NYT Connections
15.1%
# 47
MMLU Pro
68.9%
# 20
MMLU
86.0%
# 23
Halluc. Hughes
4.0%
# 18
Aidan Bench
779
# 24
Avg LiveBench (old)
56.7%
# 2
IF Evaluation
92.1%
# 34
Data LiveBench
48.3%
# 32
Language LiveBench
39.2%
# 9
Quality Artificial Analysis
74
# 155
Math RankedAGI
46.9%
# 157
RAGI RankedAGI
40.6%
Pricing
# 9
Input Cost /M
$0.1
# 12
Output Cost /M
$0.4