Claude 3 Haiku
OldAnthropic
•
Proprietary# 63
Released
Mar 7, 2024
# 13
Knowledge Cutoff
Aug 23
# 6
Context Length
200K
Benchmarks
# 87
Code RankedAGI
23.5%
# 36
LiveCodeBench v5
22.2%
# 48
Code LMArena
1184
# 58
Code LiveBench 24.11
24.5%
# 69
GPQA Diamond
33.3%
# 50
Reason LiveBench
25.9%
# 52
ELO LMArena
1179
# 48
Math LiveBench
22.9%
# 43
MATH
40.9%
# 31
Human Eval
75.9%
# 34
NYT Connections
2.2%
# 55
MMLU Pro
42.3%
# 34
MMLU
75.2%
Pricing
# 14
Input Cost /M
$0.25
# 20
Output Cost /M
$1.25
Additional Details
Model ID
claude-3-haiku-20240307
Last Updated
about 1 month ago