DeepSeek 2.5

Old

DeepSeek

•

Proprietary

•

236B

# 51

Released

Sep 12, 2024

# 11

Knowledge Cutoff

Nov 23

# 9

Context Length

128K

Benchmarks

# 75

Code RankedAGI

32.1%

# 30

Aider Polyglot

17.8%

# 30

Code LMArena

1255

# 36

Code LiveBench 24.11

46.3%

# 60

GPQA Diamond

42.0%

# 41

Reason LiveBench

39.3%

# 47

ELO LMArena

1221

# 39

MATH

55.0%

# 23

MATH 500

74.8%

# 12

Human Eval

89.0%

# 8

Human Eval+

83.5%

# 41

MMLU Pro

65.8%

# 27

MMLU

81.0%

# 49

IF LiveBench

56.7%

# 41

Data LiveBench

45.8%

# 46

Lang LiveBench

31.6%

# 49

Avg LiveBench

44.7%

Pricing

# 10

Input Cost /M

$0.14

# 10

Output Cost /M

$0.28

# 2

Cached Cost /M

$0.014