Llama 3.1

Old

Meta

•

Open Source

•

70B

# 62

Released

Jul 23, 2024

# 11

Knowledge Cutoff

Dec 23

# 9

Context Length

128K

Benchmarks

# 78

Code RankedAGI

32.7%

# 49

Code LMArena

1209

# 54

Code LiveBench (old)

32.7%

# 64

GPQA Diamond

43.0%

# 40

Reason LiveBench (old)

40.7%

# 49

ELO LMArena

1242

# 43

Math LiveBench (old)

34.4%

# 36

MATH

60.0%

# 30

Human Eval

80.5%

# 37

MMLU Pro

66.4%

# 17

MMLU

86.0%

# 29

Halluc. Hughes

5.0%

# 33

IF LiveBench (old)

69.0%

# 39

Avg LiveBench (old)

50.9%

# 7

IF Evaluation

87.5%

Pricing

# 22

Input Cost /M

$1

# 25

Output Cost /M

$3