Meta logo

Llama 3.3

Latest

Meta

Open Source

70B
# 71

Released

Dec 6, 2024

# 15

Knowledge Cutoff

Dec 23

chart

Benchmarks

# 88

Code RankedAGI

27.8%

# 43

Code LMArena

1232

# 51

Code LiveBench (old)

36.6%

# 117

Reason RankedAGI

39.9%

# 79

GPQA Diamond

50.5%

# 30

Reason LiveBench (old)

50.7%

# 47

Text Arena

1257

# 14

Human Eval

88.4%

# 2

Human Eval+

87.6%

# 30

NYT Connections

15.1%

# 41

MMLU Pro

68.9%

# 23

MMLU

86.0%

# 24

Halluc. Hughes

4.0%

# 18

Aidan Bench

779

# 27

Avg LiveBench (old)

56.7%

# 3

IF Evaluation

92.1%

# 37

Data LiveBench

48.3%

# 34

Language LiveBench

39.2%

# 9

Quality Artificial Analysis

74

# 92

RAGI Overall

48.3%

coins

Pricing

# 9

Input Cost /M

$0.1

# 12

Output Cost /M

$0.4