RankedAGI Logo
RankedAGI
Beta
Meta logo

Llama 3.1

Latest

Meta

•

Open Source

•

405B
# 122

Released

Jul 23, 2024

# 17

Knowledge Cutoff

Dec 23

# 14

Context Length

128K

chart

Benchmarks

# 188

Code RankedAGI

27.6%

# 58

SWEBench Verified

24.5%

# 190

Agentic RankedAGI

25.8%

# 34

LiveCodeBench v5

28.4%

# 27

Code LMArena

1260

# 38

Code LiveBench (old)

42.6%

# 163

Reason RankedAGI

37.0%

# 88

GPQA Diamond

51.1%

# 73

Text Arena

1266

# 12

Human Eval

89.0%

# 28

NYT Connections

16.2%

# 38

MMLU Pro

73.3%

# 16

MMLU

87.0%

# 22

Halluc. Hughes

3.9%

# 19

Aidan Bench

778

# 21

Avg LiveBench (old)

58.6%

# 8

IF Evaluation

88.6%

# 24

Data LiveBench

54.5%

# 21

Language LiveBench

45.5%

# 11

Quality Artificial Analysis

72

# 165

Math RankedAGI

45.1%

# 181

RAGI RankedAGI

37.2%

coins

Pricing

# 41

Input Cost /M

$5

# 46

Output Cost /M

$15