Qwen 2.5
LatestAlibaba
•
Open Source•
72B# 116
Released
Sep 19, 2024
# 11
Knowledge Cutoff
Sep 24
# 14
Context Length
128K
Benchmarks
# 199
Code RankedAGI
23.7%
# 60
SWEBench Verified
23.8%
# 196
Agentic RankedAGI
22.6%
# 33
LiveCodeBench v5
31.1%
# 31
Code LMArena
1247
# 17
Code LiveBench (old)
57.6%
# 179
Reason RankedAGI
33.2%
# 96
GPQA Diamond
49.0%
# 77
Text Arena
1259
# 19
Human Eval
86.6%
# 24
Human Eval+
51.2%
# 35
NYT Connections
11.1%
# 41
MMLU Pro
71.1%
# 18
MMLU
86.8%
# 28
Halluc. Hughes
4.7%
# 34
Avg LiveBench (old)
51.4%
# 33
Data LiveBench
48.4%
# 37
Language LiveBench
35.0%
# 8
Quality Artificial Analysis
75
# 177
Math RankedAGI
43.4%
# 197
RAGI RankedAGI
34.8%
Pricing
# 19
Input Cost /M
$0.38
# 16
Output Cost /M
$0.57