DeepSeek 2.5

Old

DeepSeek

•

Proprietary

•

236B

# 71

Released

Sep 12, 2024

# 14

Knowledge Cutoff

Nov 23

# 11

Context Length

128K

Benchmarks

# 102

Code RankedAGI

32.1%

# 43

Aider Polyglot

17.8%

# 35

Code LMArena

1255

# 36

Code LiveBench (old)

46.3%

# 82

GPQA Diamond

42.0%

# 41

Reason LiveBench (old)

39.3%

# 52

ELO LMArena

1221

# 39

MATH

55.0%

# 25

MATH 500

74.8%

# 12

Human Eval

89.0%

# 8

Human Eval+

83.5%

# 47

MMLU Pro

65.8%

# 37

MMLU

81.0%

# 49

IF LiveBench (old)

56.7%

# 49

Avg LiveBench (old)

44.7%

Pricing

# 10

Input Cost /M

$0.14

# 9

Output Cost /M

$0.28

# 3

Cached Cost /M

$0.014