Meta logo

Llama 3.3

Latest

Meta

Open Source

70B
# 104

Released

Dec 6, 2024

# 17

Knowledge Cutoff

Dec 23

chart

Benchmarks

# 152

Code RankedAGI

36.1%

# 164

Agentic RankedAGI

31.2%

# 36

Code LMArena

1232

# 48

Code LiveBench (old)

36.6%

# 152

Reason RankedAGI

38.6%

# 90

GPQA Diamond

50.5%

# 78

Text Arena

1257

# 14

Human Eval

88.4%

# 2

Human Eval+

87.6%

# 29

NYT Connections

15.1%

# 47

MMLU Pro

68.9%

# 20

MMLU

86.0%

# 23

Halluc. Hughes

4.0%

# 18

Aidan Bench

779

# 24

Avg LiveBench (old)

56.7%

# 2

IF Evaluation

92.1%

# 34

Data LiveBench

48.3%

# 32

Language LiveBench

39.2%

# 9

Quality Artificial Analysis

74

# 155

Math RankedAGI

46.9%

# 157

RAGI RankedAGI

40.6%

coins

Pricing

# 9

Input Cost /M

$0.1

# 12

Output Cost /M

$0.4