o1 mini

Latest

OpenAI

•

Proprietary

# 44

Released

Sep 12, 2024

# 11

Knowledge Cutoff

Oct 23

# 7

Context Length

128K

Benchmarks

# 33

Code LiveBench

48.0%

# 13

Aider Polyglot

32.9%

# 13

SWEBench Verified

35.0%

# 9

Codeforces ELO

1650

# 10

WebDev Arena

1053.69

# 6

LiveCodeBench v5

68.4%

# 16

Code LMArena

1292

# 26

GPQA Diamond

60.0%

# 9

Reason LiveBench

77.3%

# 22

ELO LMArena

1308

# 19

Math LiveBench

59.2%

# 7

MATH

90.0%

# 14

MATH 500

90.0%

# 3

Human Eval

92.4%

# 1

Human Eval+

89.0%

# 10

NYT Connections

26.4%

# 9

Aider Old

70.7%

# 4

MMLU Pro

80.3%

# 16

MMLU

85.0%

# 5

Halluc. Hughes

1.4%

# 6

Aidan Bench

1577

# 17

AIME 2024

63.6%

# 39

IF LiveBench

65.4%

# 29

Data LiveBench

54.1%

# 27

Lang LiveBench

40.9%

# 33

Avg LiveBench

53.4%

Pricing

# 26

Input Cost /M

$3

# 28

Output Cost /M

$12

Additional Details

Model ID

o1-mini

Last Updated

12 days ago