RankedAGI Logo
RankedAGI
Beta
Anthropic logo

Claude 3.5 Haiku

Latest

Anthropic

•

Proprietary
# 52

Released

Oct 22, 2024

# 8

Knowledge Cutoff

Jul 24

# 6

Context Length

200K

chart

Benchmarks

# 64

Code RankedAGI

40.0%

# 29

Aider Polyglot

28.0%

# 21

SWEBench Verified

40.6%

# 16

WebDev Arena

1134.43

# 32

Code LMArena

1263

# 29

Code LiveBench (old)

51.4%

# 67

GPQA Diamond

41.6%

# 47

Reason LiveBench (old)

29.3%

# 50

ELO LMArena

1239

# 42

Math LiveBench (old)

35.5%

# 26

MATH

73.0%

# 15

Human Eval

88.1%

# 29

NYT Connections

10.3%

# 42

MMLU Pro

65.0%

# 30

MMLU

81.0%

# 28

Halluc. Hughes

4.9%

# 15

Aidan Bench

904

# 45

IF LiveBench (old)

61.9%

# 46

Avg LiveBench (old)

47.8%

coins

Pricing

# 22

Input Cost /M

$1

# 28

Output Cost /M

$5

# 6

Cached Cost /M

$0.1

sparkle-2

Additional Details

Model ID

claude-3-5-haiku-20241022

Last Updated

3 months ago