o1 Preview

Old

OpenAI

•

Proprietary

# 51

Released

Sep 12, 2024

# 12

Knowledge Cutoff

Oct 23

# 9

Context Length

128K

Benchmarks

# 37

Code RankedAGI

48.7%

# 13

SWEBench Verified

41.0%

# 18

Codeforces ELO

1258

# 17

LiveCodeBench v5

55.6%

# 14

Code LMArena

1312

# 31

Code LiveBench 24.11

50.8%

# 14

GPQA Diamond

73.3%

# 13

Reason LiveBench

68.0%

# 18

ELO LMArena

1333

# 15

Math LiveBench

62.9%

# 12

MATH

85.0%

# 3

Human Eval

92.4%

# 1

Human Eval+

89.0%

# 1

MMLU

91.0%

# 15

Halluc. Hughes

3.3%

# 5

Aidan Bench

1892

# 27

AIME 2024

56.7%

# 25

IF LiveBench

74.6%

# 15

Data LiveBench

64.0%

# 2

Lang LiveBench

68.7%

# 9

Avg LiveBench

69.1%

Pricing

# 30

Input Cost /M

$15

# 35

Output Cost /M

$60

Additional Details

Model ID

o1-preview

Last Updated

about 1 month ago