RankedAGI Logo
RankedAGI
Beta
Anthropic logo

Claude 3.5 Haiku

Latest

Anthropic

•

Proprietary
# 47

Released

Oct 22, 2024

# 7

Knowledge Cutoff

Jul 24

# 6

Context Length

200K

chart

Benchmarks

# 60

Code RankedAGI

40.0%

# 24

Aider Polyglot

28.0%

# 15

SWEBench Verified

40.6%

# 13

WebDev Arena

1134.43

# 27

Code LMArena

1263

# 29

Code LiveBench 24.11

51.4%

# 61

GPQA Diamond

41.6%

# 47

Reason LiveBench

29.3%

# 45

ELO LMArena

1239

# 42

Math LiveBench

35.5%

# 26

MATH

73.0%

# 15

Human Eval

88.1%

# 29

NYT Connections

10.3%

# 43

MMLU Pro

65.0%

# 27

MMLU

81.0%

# 24

Halluc. Hughes

4.9%

# 15

Aidan Bench

904

# 45

IF LiveBench

61.9%

# 50

Data LiveBench

42.4%

# 39

Lang LiveBench

35.4%

# 46

Avg LiveBench

47.8%

coins

Pricing

# 22

Input Cost /M

$1

# 28

Output Cost /M

$5

# 6

Cached Cost /M

$0.1

sparkle-2

Additional Details

Model ID

claude-3-5-haiku-20241022

Last Updated

about 1 month ago