DeepSeek 2.5

Old

DeepSeek

•

Proprietary

•

236B

# 56

Released

Sep 12, 2024

# 12

Knowledge Cutoff

Nov 23

# 9

Context Length

128K

Benchmarks

# 82

Code RankedAGI

32.1%

# 36

Aider Polyglot

17.8%

# 35

Code LMArena

1255

# 36

Code LiveBench (old)

46.3%

# 66

GPQA Diamond

42.0%

# 41

Reason LiveBench (old)

39.3%

# 52

ELO LMArena

1221

# 39

MATH

55.0%

# 23

MATH 500

74.8%

# 12

Human Eval

89.0%

# 8

Human Eval+

83.5%

# 40

MMLU Pro

65.8%

# 30

MMLU

81.0%

# 49

IF LiveBench (old)

56.7%

# 49

Avg LiveBench (old)

44.7%

Pricing

# 10

Input Cost /M

$0.14

# 10

Output Cost /M

$0.28

# 2

Cached Cost /M

$0.014