RankedAGI Logo
RankedAGI
Beta
Anthropic logo

Claude 3 Opus

Latest

Anthropic

•

Proprietary
# 68

Released

Mar 4, 2024

# 14

Knowledge Cutoff

Aug 23

# 6

Context Length

200K

chart

Benchmarks

# 83

Code RankedAGI

30.3%

# 29

SWEBench Verified

22.0%

# 42

Code LMArena

1236

# 46

Code LiveBench (old)

38.6%

# 52

GPQA Diamond

50.4%

# 39

Reason LiveBench (old)

41.3%

# 47

ELO LMArena

1248

# 35

Math LiveBench (old)

43.4%

# 35

MATH

60.1%

# 22

Human Eval

84.9%

# 17

Human Eval+

77.4%

# 33

MMLU Pro

68.5%

# 25

MMLU

84.0%

# 39

Halluc. Hughes

10.1%

# 14

Aidan Bench

908

# 43

IF LiveBench (old)

63.9%

# 29

Avg LiveBench (old)

56.2%

coins

Pricing

# 30

Input Cost /M

$15

# 35

Output Cost /M

$75

# 14

Cached Cost /M

$1.5

sparkle-2

Additional Details

Model ID

claude-3-opus-20240229

Last Updated

3 months ago