Claude 3 Opus

Latest

Anthropic

•

Proprietary

# 63

Released

Mar 4, 2024

# 13

Knowledge Cutoff

Aug 23

# 6

Context Length

200K

Benchmarks

# 76

Code RankedAGI

30.3%

# 23

SWEBench Verified

22.0%

# 37

Code LMArena

1236

# 46

Code LiveBench 24.11

38.6%

# 46

GPQA Diamond

50.4%

# 39

Reason LiveBench

41.3%

# 42

ELO LMArena

1248

# 35

Math LiveBench

43.4%

# 35

MATH

60.1%

# 22

Human Eval

84.9%

# 17

Human Eval+

77.4%

# 34

MMLU Pro

68.5%

# 23

MMLU

84.0%

# 34

Halluc. Hughes

10.1%

# 14

Aidan Bench

908

# 43

IF LiveBench

63.9%

# 28

Data LiveBench

54.3%

# 14

Lang LiveBench

50.4%

# 29

Avg LiveBench

56.2%

Pricing

# 30

Input Cost /M

$15

# 36

Output Cost /M

$75

# 14

Cached Cost /M

$1.5

Additional Details

Model ID

claude-3-opus-20240229

Last Updated

about 1 month ago