Qwen 2.5 Coder

Latest

Alibaba

•

Open Source

•

32B

# 52

Released

Nov 12, 2024

# 6

Knowledge Cutoff

Sep 24

# 9

Context Length

128K

Benchmarks

# 80

Code RankedAGI

32.4%

# 40

Aider Polyglot

8.0%

# 31

WebDev Arena

903.59

# 46

Code LMArena

1227

# 22

Code LiveBench (old)

56.9%

# 70

GPQA Diamond

41.0%

# 34

Reason LiveBench (old)

47.3%

# 53

ELO LMArena

1220

# 32

Math LiveBench (old)

46.0%

# 27

MATH

72.0%

# 2

Human Eval

92.7%

# 5

Human Eval+

86.3%

# 34

MMLU

79.0%

# 46

IF LiveBench (old)

58.7%

# 48

Avg LiveBench (old)

45.6%

Pricing

# 13

Input Cost /M

$0.2

# 8

Output Cost /M

$0.2