Claude 3.5 Sonnet
OldAnthropic
•
Proprietary# 125
Released
Jun 20, 2024
# 16
Knowledge Cutoff
Apr 24
# 9
Context Length
200K
Benchmarks
# 159
Code RankedAGI
34.4%
# 55
SWEBench Verified
33.4%
# 171
Agentic RankedAGI
29.5%
# 30
LiveCodeBench v5
36.0%
# 21
Code LMArena
1282
# 15
Code LiveBench (old)
60.9%
# 132
Reason RankedAGI
41.0%
# 76
GPQA Diamond
59.4%
# 72
Text Arena
1268
# 5
Human Eval
92.0%
# 12
Human Eval+
81.7%
# 28
MMLU Pro
76.1%
# 11
MMLU
88.7%
# 23
MMMU
68.3%
# 8
Aidan Bench
1439
# 19
Avg LiveBench (old)
59.7%
# 22
Data LiveBench
56.7%
# 9
Language LiveBench
53.2%
# 7
Quality Artificial Analysis
76
# 154
Math RankedAGI
46.1%
# 156
RAGI RankedAGI
40.3%
Pricing
# 39
Input Cost /M
$3
# 46
Output Cost /M
$15