Claude 3 Opus
LatestAnthropic
•
Proprietary# 56
Released
Mar 4, 2024
# 12
Knowledge Cutoff
Aug 23
# 5
Context Length
200K
Benchmarks
# 45
Code LiveBench
38.6%
# 18
SWEBench Verified
22.0%
# 34
Code LMArena
1236
# 39
GPQA Diamond
50.4%
# 38
Reason LiveBench
41.3%
# 40
ELO LMArena
1248
# 34
Math LiveBench
43.4%
# 35
MATH
60.1%
# 21
Human Eval
84.9%
# 17
Human Eval+
77.4%
# 12
Aider Old
68.4%
# 30
MMLU Pro
68.5%
# 19
MMLU
84.0%
# 31
Halluc. Hughes
10.1%
# 14
Aidan Bench
908
# 43
IF LiveBench
63.9%
# 28
Data LiveBench
54.3%
# 13
Lang LiveBench
50.4%
# 28
Avg LiveBench
56.2%
Pricing
# 28
Input Cost /M
$15
# 31
Output Cost /M
$75
# 12
Cached Cost /M
$1.5
Additional Details
Model ID
claude-3-opus-20240229
Last Updated
about 1 month ago