RankedAGI Logo
RankedAGI
Beta
Anthropic logo

Claude 3.5 Haiku

Latest

Anthropic

•

Proprietary
# 55

Released

Oct 22, 2024

# 8

Knowledge Cutoff

Jul 24

# 6

Context Length

200K

chart

Benchmarks

# 68

Code RankedAGI

40.0%

# 30

Aider Polyglot

28.0%

# 24

SWEBench Verified

40.6%

# 16

WebDev Arena

1134.43

# 32

Code LMArena

1263

# 6

Svelte Bench

73.3%

# 29

Code LiveBench (old)

51.4%

# 70

GPQA Diamond

41.6%

# 47

Reason LiveBench (old)

29.3%

# 50

ELO LMArena

1239

# 42

Math LiveBench (old)

35.5%

# 26

MATH

73.0%

# 15

Human Eval

88.1%

# 29

NYT Connections

10.3%

# 43

MMLU Pro

65.0%

# 31

MMLU

81.0%

# 28

Halluc. Hughes

4.9%

# 15

Aidan Bench

904

# 45

IF LiveBench (old)

61.9%

# 46

Avg LiveBench (old)

47.8%

coins

Pricing

# 23

Input Cost /M

$1

# 28

Output Cost /M

$5

# 6

Cached Cost /M

$0.1

sparkle-2

Additional Details

Model ID

claude-3-5-haiku-20241022

Last Updated

7 days ago