Claude 3.7 Sonnet
LatestAnthropic
•
Proprietary# 21
Released
Feb 24, 2025
# 4
Knowledge Cutoff
Oct 24
# 6
Context Length
200K
Benchmarks
# 24
Code RankedAGI
57.7%
# 31
Code LiveBench
32.4%
# 8
Aider Polyglot
60.4%
# 3
SWEBench Verified
70.3%
# 2
WebDev Arena
1355.76
# 12
Code LMArena
1326
# 8
Code LiveBench 24.11
67.5%
# 23
GPQA Diamond
68.0%
# 15
Reason LiveBench
66.0%
# 27
ELO LMArena
1295
# 14
Math LiveBench
63.3%
# 21
MATH 500
82.2%
# 14
NYT Connections
19.2%
# 13
MMMU
71.8%
# 39
AIME 2024
23.3%
# 21
IF LiveBench
76.5%
# 16
Data LiveBench
63.4%
# 7
Lang LiveBench
56.8%
# 13
Avg LiveBench
65.6%
# 3
IF Evaluation
90.8%
Pricing
# 27
Input Cost /M
$3
# 33
Output Cost /M
$15