Qwen 2.5

Latest

Alibaba

•

Open Source

•

72B

# 50

Released

Sep 19, 2024

# 5

Knowledge Cutoff

Sep 24

# 9

Context Length

128K

Benchmarks

# 63

Code RankedAGI

38.0%

# 22

SWEBench Verified

23.8%

# 33

LiveCodeBench v5

31.1%

# 33

Code LMArena

1247

# 20

Code LiveBench 24.11

57.6%

# 50

GPQA Diamond

49.0%

# 35

Reason LiveBench

46.0%

# 37

ELO LMArena

1259

# 26

Math LiveBench

52.4%

# 13

MATH

83.1%

# 19

Human Eval

86.6%

# 24

Human Eval+

51.2%

# 28

NYT Connections

11.1%

# 27

MMLU Pro

71.1%

# 14

MMLU

86.8%

# 23

Halluc. Hughes

4.7%

# 42

IF LiveBench

64.4%

# 36

Data LiveBench

48.4%

# 40

Lang LiveBench

35.0%

# 37

Avg LiveBench

51.4%

Pricing

# 17

Input Cost /M

$0.38

# 16

Output Cost /M

$0.57