Claude 3.5 Sonnet
OldAnthropic
•
Proprietary# 69
Released
Jun 20, 2024
# 10
Knowledge Cutoff
Apr 24
# 6
Context Length
200K
Benchmarks
# 57
Code RankedAGI
44.0%
# 27
SWEBench Verified
33.4%
# 31
LiveCodeBench v5
36.0%
# 28
Code LMArena
1282
# 18
Code LiveBench (old)
60.9%
# 41
GPQA Diamond
59.4%
# 20
Reason LiveBench (old)
58.7%
# 38
ELO LMArena
1268
# 25
Math LiveBench (old)
53.3%
# 28
MATH
71.1%
# 5
Human Eval
92.0%
# 12
Human Eval+
81.7%
# 14
MMLU Pro
76.1%
# 9
MMLU
88.7%
# 21
MMMU
68.3%
# 8
Aidan Bench
1439
# 35
IF LiveBench (old)
68.0%
# 22
Avg LiveBench (old)
59.7%
Pricing
# 28
Input Cost /M
$3
# 33
Output Cost /M
$15