Claude 3.7 Sonnet
LatestAnthropic
•
Proprietary# 28
Released
Feb 24, 2025
# 5
Knowledge Cutoff
Oct 24
# 6
Context Length
200K
Benchmarks
# 29
Code RankedAGI
57.7%
# 12
Aider Polyglot
60.4%
# 4
SWEBench Verified
70.3%
# 5
WebDev Arena
1355.76
# 17
Code LMArena
1326
# 11
Svelte Bench
56.7%
# 8
Code LiveBench (old)
67.5%
# 28
GPQA Diamond
68.0%
# 15
Reason LiveBench (old)
66.0%
# 19
ELO LMArena
1365
# 14
Math LiveBench (old)
63.3%
# 22
MATH 500
82.2%
# 16
Humanity Last Exam
8.0%
# 14
NYT Connections
19.2%
# 16
MMMU
71.8%
# 40
AIME 2024
23.3%
# 21
IF LiveBench (old)
76.5%
# 13
Avg LiveBench (old)
65.6%
# 3
IF Evaluation
90.8%
Pricing
# 27
Input Cost /M
$3
# 33
Output Cost /M
$15