Claude 3.5 Sonnet
OldAnthropic
•
Proprietary# 117
Released
Jun 20, 2024
# 16
Knowledge Cutoff
Apr 24
# 9
Context Length
200K
Benchmarks
# 149
Code RankedAGI
34.5%
# 60
SWEBench Verified
33.4%
# 139
Agentic RankedAGI
28.8%
# 33
LiveCodeBench v5
36.0%
# 28
Code LMArena
1282
# 18
Code LiveBench (old)
60.9%
# 126
Reason RankedAGI
38.1%
# 86
GPQA Diamond
59.4%
# 69
Text Arena
1268
# 5
Human Eval
92.0%
# 12
Human Eval+
81.7%
# 30
MMLU Pro
76.1%
# 13
MMLU
88.7%
# 28
MMMU
68.3%
# 8
Aidan Bench
1439
# 22
Avg LiveBench (old)
59.7%
# 25
Data LiveBench
56.7%
# 10
Language LiveBench
53.2%
# 7
Quality Artificial Analysis
76
# 133
Math RankedAGI
45.0%
# 141
RAGI RankedAGI
39.5%
Pricing
# 39
Input Cost /M
$3
# 45
Output Cost /M
$15