o1 Preview

Old

OpenAI

•

Proprietary

# 56

Released

Sep 12, 2024

# 13

Knowledge Cutoff

Oct 23

# 9

Context Length

128K

Benchmarks

# 44

Code RankedAGI

48.7%

# 19

SWEBench Verified

41.0%

# 18

LiveCodeBench v5

55.6%

# 18

Codeforces ELO

1258

# 19

Code LMArena

1312

# 31

Code LiveBench (old)

50.8%

# 19

GPQA Diamond

73.3%

# 13

Reason LiveBench (old)

68.0%

# 17

ELO LMArena

1372

# 15

Math LiveBench (old)

62.9%

# 12

MATH

85.0%

# 3

Human Eval

92.4%

# 1

Human Eval+

89.0%

# 1

MMLU

91.0%

# 19

Halluc. Hughes

3.3%

# 5

Aidan Bench

1892

# 27

AIME 2024

56.7%

# 25

IF LiveBench (old)

74.6%

# 9

Avg LiveBench (old)

69.1%

Pricing

# 30

Input Cost /M

$15

# 34

Output Cost /M

$60

Additional Details

Model ID

o1-preview

Last Updated

30 days ago