o1 Preview

Old

OpenAI

•

Proprietary

# 44

Released

Sep 12, 2024

# 11

Knowledge Cutoff

Oct 23

# 7

Context Length

128K

Benchmarks

# 30

Code LiveBench

50.8%

# 9

SWEBench Verified

41.0%

# 13

Codeforces ELO

1258

# 12

LiveCodeBench v5

55.6%

# 12

Code LMArena

1312

# 11

GPQA Diamond

73.3%

# 12

Reason LiveBench

68.0%

# 17

ELO LMArena

1333

# 14

Math LiveBench

62.9%

# 12

MATH

85.0%

# 3

Human Eval

92.4%

# 1

Human Eval+

89.0%

# 3

Aider Old

79.7%

# 1

MMLU

91.0%

# 14

Halluc. Hughes

3.3%

# 5

Aidan Bench

1892

# 20

AIME 2024

56.7%

# 25

IF LiveBench

74.6%

# 15

Data LiveBench

64.0%

# 1

Lang LiveBench

68.7%

# 8

Avg LiveBench

69.1%

Pricing

# 28

Input Cost /M

$15

# 30

Output Cost /M

$60

Additional Details

Model ID

o1-preview

Last Updated

about 1 month ago