Llama 3.1

Latest

Meta

•

Open Source

•

8B

# 77

Released

Jul 23, 2024

# 13

Knowledge Cutoff

Dec 23

# 11

Context Length

128K

Benchmarks

# 117

Code RankedAGI

19.7%

# 56

Code LMArena

1174

# 64

Code LiveBench (old)

19.7%

# 91

GPQA Diamond

27.0%

# 53

Reason LiveBench (old)

15.3%

# 59

ELO LMArena

1171

# 51

Math LiveBench (old)

16.6%

# 34

MATH

64.0%

# 33

Human Eval

72.6%

# 21

Human Eval+

62.8%

# 59

MMLU Pro

44.3%

# 48

MMLU

71.0%

# 30

Halluc. Hughes

5.4%

Pricing

# 16

Input Cost /M

$0.3

# 16

Output Cost /M

$0.6