Claude 3 Haiku
OldAnthropic
•
Proprietary# 127
Released
Mar 7, 2024
# 20
Knowledge Cutoff
Aug 23
# 10
Context Length
200K
Benchmarks
# 205
Code RankedAGI
19.9%
# 203
Agentic RankedAGI
20.7%
# 41
LiveCodeBench v6
19.6%
# 36
LiveCodeBench v5
22.2%
# 46
Code LMArena
1184
# 55
Code LiveBench (old)
24.5%
# 201
Reason RankedAGI
26.4%
# 114
GPQA Diamond
33.3%
# 90
Text Arena
1179
# 31
Human Eval
75.9%
# 41
NYT Connections
2.2%
# 70
MMLU Pro
42.3%
# 38
MMLU
75.2%
# 18
Quality Artificial Analysis
54
# 201
Math RankedAGI
37.8%
# 203
RAGI RankedAGI
31.7%
Pricing
# 15
Input Cost /M
$0.25
# 23
Output Cost /M
$1.25
Additional Details
Model ID
claude-3-haiku-20240307
Last Updated
about 1 year ago