Claude 3 Haiku

Old

Anthropic

•

Proprietary

# 66

Released

Mar 7, 2024

# 14

Knowledge Cutoff

Aug 23

# 6

Context Length

200K

Benchmarks

# 90

Code RankedAGI

22.3%

# 20

LiveCodeBench v6

19.6%

# 37

LiveCodeBench v5

22.2%

# 53

Code LMArena

1184

# 58

Code LiveBench (old)

24.5%

# 71

GPQA Diamond

33.3%

# 50

Reason LiveBench (old)

25.9%

# 57

ELO LMArena

1179

# 48

Math LiveBench (old)

22.9%

# 43

MATH

40.9%

# 31

Human Eval

75.9%

# 34

NYT Connections

2.2%

# 54

MMLU Pro

42.3%

# 35

MMLU

75.2%

Pricing

# 14

Input Cost /M

$0.25

# 20

Output Cost /M

$1.25

Additional Details

Model ID

claude-3-haiku-20240307

Last Updated

15 days ago