Anthropic logo

Claude 3 Haiku

Old

Anthropic

Proprietary
# 69

Released

Mar 7, 2024

# 14

Knowledge Cutoff

Aug 23

# 6

Context Length

200K

chart

Benchmarks

# 94

Code RankedAGI

22.3%

# 23

LiveCodeBench v6

19.6%

# 37

LiveCodeBench v5

22.2%

# 53

Code LMArena

1184

# 58

Code LiveBench (old)

24.5%

# 76

GPQA Diamond

33.3%

# 50

Reason LiveBench (old)

25.9%

# 57

ELO LMArena

1179

# 48

Math LiveBench (old)

22.9%

# 43

MATH

40.9%

# 31

Human Eval

75.9%

# 34

NYT Connections

2.2%

# 55

MMLU Pro

42.3%

# 38

MMLU

75.2%

coins

Pricing

# 14

Input Cost /M

$0.25

# 20

Output Cost /M

$1.25

sparkle-2

Additional Details

Model ID

claude-3-haiku-20240307

Last Updated

about 1 month ago