Llama 3.3

Latest

Meta

•

Open Source

•

70B

# 38

Released

Dec 6, 2024

# 10

Knowledge Cutoff

Dec 23

Benchmarks

# 66

Code RankedAGI

36.6%

# 38

Code LMArena

1232

# 51

Code LiveBench 24.11

36.6%

# 45

GPQA Diamond

50.5%

# 30

Reason LiveBench

50.7%

# 39

ELO LMArena

1257

# 37

Math LiveBench

41.1%

# 20

MATH

77.0%

# 14

Human Eval

88.4%

# 2

Human Eval+

87.6%

# 22

NYT Connections

15.1%

# 32

MMLU Pro

68.9%

# 16

MMLU

86.0%

# 18

Halluc. Hughes

4.0%

# 18

Aidan Bench

779

# 5

IF LiveBench

82.7%

# 37

Data LiveBench

48.3%

# 34

Lang LiveBench

39.2%

# 27

Avg LiveBench

56.7%

# 2

IF Evaluation

92.1%

Pricing

# 9

Input Cost /M

$0.1

# 12

Output Cost /M

$0.4