Llama 3.3
LatestMeta
•
Open Source•
70B# 71
Released
Dec 6, 2024
# 15
Knowledge Cutoff
Dec 23
Benchmarks
# 88
Code RankedAGI
27.8%
# 43
Code LMArena
1232
# 51
Code LiveBench (old)
36.6%
# 117
Reason RankedAGI
39.9%
# 79
GPQA Diamond
50.5%
# 30
Reason LiveBench (old)
50.7%
# 47
Text Arena
1257
# 14
Human Eval
88.4%
# 2
Human Eval+
87.6%
# 30
NYT Connections
15.1%
# 41
MMLU Pro
68.9%
# 23
MMLU
86.0%
# 24
Halluc. Hughes
4.0%
# 18
Aidan Bench
779
# 27
Avg LiveBench (old)
56.7%
# 3
IF Evaluation
92.1%
# 37
Data LiveBench
48.3%
# 34
Language LiveBench
39.2%
# 9
Quality Artificial Analysis
74
# 92
RAGI Overall
48.3%
Pricing
# 9
Input Cost /M
$0.1
# 12
Output Cost /M
$0.4