o1 mini

Latest

OpenAI

•

Proprietary

# 51

Released

Sep 12, 2024

# 12

Knowledge Cutoff

Oct 23

# 9

Context Length

128K

Benchmarks

# 46

Code RankedAGI

44.9%

# 23

Aider Polyglot

32.9%

# 17

SWEBench Verified

35.0%

# 14

Codeforces ELO

1650

# 17

WebDev Arena

1053.69

# 8

LiveCodeBench v5

68.4%

# 18

Code LMArena

1292

# 34

Code LiveBench 24.11

48.0%

# 31

GPQA Diamond

60.0%

# 10

Reason LiveBench

77.3%

# 23

ELO LMArena

1308

# 20

Math LiveBench

59.2%

# 7

MATH

90.0%

# 16

MATH 500

90.0%

# 3

Human Eval

92.4%

# 1

Human Eval+

89.0%

# 10

NYT Connections

26.4%

# 7

MMLU Pro

80.3%

# 19

MMLU

85.0%

# 6

Halluc. Hughes

1.4%

# 6

Aidan Bench

1577

# 24

AIME 2024

63.6%

# 39

IF LiveBench

65.4%

# 29

Data LiveBench

54.1%

# 28

Lang LiveBench

40.9%

# 34

Avg LiveBench

53.4%

Pricing

# 27

Input Cost /M

$3

# 32

Output Cost /M

$12

Additional Details

Model ID

o1-mini

Last Updated

about 1 month ago