Claude 3 Haiku
OldAnthropic
•
Proprietary# 93
Released
Mar 7, 2024
# 18
Knowledge Cutoff
Aug 23
# 9
Context Length
200K
Benchmarks
# 148
Code RankedAGI
27.2%
# 34
LiveCodeBench v6
19.6%
# 39
LiveCodeBench v5
22.2%
# 53
Code LMArena
1184
# 58
Code LiveBench (old)
24.5%
# 144
Reason RankedAGI
23.7%
# 101
GPQA Diamond
33.3%
# 50
Reason LiveBench (old)
25.9%
# 60
Text Arena
1179
# 31
Human Eval
75.9%
# 42
NYT Connections
2.2%
# 63
MMLU Pro
42.3%
# 44
MMLU
75.2%
# 18
Quality Artificial Analysis
54
# 168
RAGI Overall
32.7%
Pricing
# 14
Input Cost /M
$0.25
# 22
Output Cost /M
$1.25
Additional Details
Model ID
claude-3-haiku-20240307
Last Updated
about 10 months ago