RankedAGI Logo
RankedAGI
Beta
OpenAI logo

o1 Preview

Old

OpenAI

•

Proprietary
# 84

Released

Sep 12, 2024

# 17

Knowledge Cutoff

Oct 23

# 13

Context Length

128K

chart

Benchmarks

# 38

Code RankedAGI

54.9%

# 41

SWEBench Verified

41.0%

# 20

LiveCodeBench v5

55.6%

# 19

Code LMArena

1312

# 21

Codeforces ELO

1258

# 31

Code LiveBench (old)

50.8%

# 36

Reason RankedAGI

59.6%

# 44

GPQA Diamond

73.3%

# 13

Reason LiveBench (old)

68.0%

# 20

Text Arena

1372

# 32

AIME 2024

56.7%

# 3

Human Eval

92.4%

# 1

Human Eval+

89.0%

# 4

MMLU

91.0%

# 21

Halluc. Hughes

3.3%

# 5

Aidan Bench

1892

# 9

Avg LiveBench (old)

69.1%

# 15

Data LiveBench

64.0%

# 2

Language LiveBench

68.7%

# 3

Quality Artificial Analysis

85

# 68

Math RankedAGI

53.8%

# 39

RAGI Overall

55.1%

coins

Pricing

# 37

Input Cost /M

$15

# 39

Output Cost /M

$60

sparkle-2

Additional Details

Model ID

o1-preview

Last Updated

about 10 months ago