Deepseek V3

Old

DeepSeek

•

Open Source

•

671B

# 32

Released

Dec 26, 2024

# 7

Knowledge Cutoff

Jul 24

# 9

Context Length

128K

Benchmarks

# 38

Code RankedAGI

48.6%

# 16

Aider Polyglot

48.4%

# 12

SWEBench Verified

42.0%

# 21

Codeforces ELO

1134

# 27

WebDev Arena

963.91

# 26

LiveCodeBench v5

40.5%

# 24

Code LMArena

1279

# 16

Code LiveBench 24.11

61.8%

# 33

GPQA Diamond

59.1%

# 24

Reason LiveBench

56.8%

# 20

ELO LMArena

1315

# 28

AIME 2025 I & II

25.0%

# 18

Math LiveBench

60.5%

# 15

MATH 500

90.2%

# 27

Human Eval

82.6%

# 4

Human Eval+

86.6%

# 22

NYT Connections

15.1%

# 16

MMLU Pro

75.9%

# 8

MMLU

88.5%

# 17

Halluc. Hughes

3.9%

# 24

IF LiveBench

75.3%

# 19

Data LiveBench

60.9%

# 19

Lang LiveBench

47.5%

# 21

Avg LiveBench

60.5%

# 9

IF Evaluation

86.1%

Pricing

# 6

Input Cost /M

$0.07

# 19

Output Cost /M

$1.1

# 8

Cached Cost /M

$0.27

Additional Details

Model ID

deepseek-chat

Last Updated

about 1 month ago