o1 mini

Latest

OpenAI

•

Proprietary

# 69

Released

Sep 12, 2024

# 15

Knowledge Cutoff

Oct 23

# 11

Context Length

128K

Benchmarks

# 67

Code RankedAGI

44.9%

# 35

Aider Polyglot

32.9%

# 33

SWEBench Verified

35.0%

# 20

WebDev Arena

1053.69

# 10

LiveCodeBench v5

68.4%

# 15

Codeforces ELO

1650

# 23

Code LMArena

1292

# 34

Code LiveBench (old)

48.0%

# 52

GPQA Diamond

60.0%

# 10

Reason LiveBench (old)

77.3%

# 30

ELO LMArena

1308

# 20

Math LiveBench (old)

59.2%

# 7

MATH

90.0%

# 17

MATH 500

90.0%

# 3

Human Eval

92.4%

# 1

Human Eval+

89.0%

# 10

NYT Connections

26.4%

# 12

MMLU Pro

80.3%

# 27

MMLU

85.0%

# 6

Halluc. Hughes

1.4%

# 6

Aidan Bench

1577

# 29

AIME 2024

63.6%

# 39

IF LiveBench (old)

65.4%

# 34

Avg LiveBench (old)

53.4%

Pricing

# 30

Input Cost /M

$3

# 34

Output Cost /M

$12

Additional Details

Model ID

o1-mini

Last Updated

4 months ago