RankedAGI Logo
RankedAGI
Beta
OpenAI logo

o1 Preview

Old

OpenAI

•

Proprietary
# 104

Released

Sep 12, 2024

# 19

Knowledge Cutoff

Oct 23

# 13

Context Length

128K

chart

Benchmarks

# 97

Code RankedAGI

48.1%

# 55

SWEBench Verified

41.0%

# 86

Agentic RankedAGI

40.8%

# 20

LiveCodeBench v5

55.6%

# 19

Code LMArena

1312

# 26

Codeforces ELO

1258

# 31

Code LiveBench (old)

50.8%

# 91

Reason RankedAGI

46.2%

# 62

GPQA Diamond

73.3%

# 38

Text Arena

1388

# 31

AIME 2024

56.7%

# 3

Human Eval

92.4%

# 1

Human Eval+

89.0%

# 4

MMLU

91.0%

# 21

Halluc. Hughes

3.3%

# 5

Aidan Bench

1892

# 9

Avg LiveBench (old)

69.1%

# 15

Data LiveBench

64.0%

# 2

Language LiveBench

68.7%

# 3

Quality Artificial Analysis

85

# 108

Math RankedAGI

55.8%

# 94

RAGI RankedAGI

47.5%

coins

Pricing

# 42

Input Cost /M

$15

# 47

Output Cost /M

$60

sparkle-2

Additional Details

Model ID

o1-preview

Last Updated

2 days ago