Meta logo

Llama 3.3

Latest

Meta

•

Open Source

•

70B
# 105

Released

Dec 6, 2024

# 17

Knowledge Cutoff

Dec 23

chart

Benchmarks

# 160

Code RankedAGI

34.4%

# 179

Agentic RankedAGI

29.1%

# 36

Code LMArena

1232

# 48

Code LiveBench (old)

36.6%

# 157

Reason RankedAGI

37.9%

# 90

GPQA Diamond

50.5%

# 78

Text Arena

1257

# 14

Human Eval

88.4%

# 2

Human Eval+

87.6%

# 29

NYT Connections

15.1%

# 47

MMLU Pro

68.9%

# 20

MMLU

86.0%

# 23

Halluc. Hughes

4.0%

# 18

Aidan Bench

779

# 24

Avg LiveBench (old)

56.7%

# 2

IF Evaluation

92.1%

# 34

Data LiveBench

48.3%

# 32

Language LiveBench

39.2%

# 9

Quality Artificial Analysis

74

# 155

Math RankedAGI

46.3%

# 169

RAGI RankedAGI

39.6%

coins

Pricing

# 9

Input Cost /M

$0.1

# 12

Output Cost /M

$0.4