RankedAGI Logo
RankedAGI
Beta
Meta logo

Llama 3.1

Latest

Meta

•

Open Source

•

8B
# 116

Released

Jul 23, 2024

# 17

Knowledge Cutoff

Dec 23

# 13

Context Length

128K

chart

Benchmarks

# 210

Code RankedAGI

19.6%

# 210

Agentic RankedAGI

19.4%

# 56

Code LMArena

1174

# 64

Code LiveBench (old)

19.7%

# 203

Reason RankedAGI

27.9%

# 127

GPQA Diamond

27.0%

# 89

Text Arena

1171

# 33

Human Eval

72.6%

# 21

Human Eval+

62.8%

# 71

MMLU Pro

44.3%

# 47

MMLU

71.0%

# 32

Halluc. Hughes

5.4%

# 19

Quality Artificial Analysis

53

# 208

Math RankedAGI

37.2%

# 209

RAGI RankedAGI

31.7%

coins

Pricing

# 18

Input Cost /M

$0.3

# 17

Output Cost /M

$0.6