o1 mini

Latest

OpenAI

•

Proprietary

# 56

Released

Sep 12, 2024

# 13

Knowledge Cutoff

Oct 23

# 9

Context Length

128K

Benchmarks

# 51

Code RankedAGI

44.9%

# 28

Aider Polyglot

32.9%

# 23

SWEBench Verified

35.0%

# 20

WebDev Arena

1053.69

# 9

LiveCodeBench v5

68.4%

# 14

Codeforces ELO

1650

# 23

Code LMArena

1292

# 34

Code LiveBench (old)

48.0%

# 37

GPQA Diamond

60.0%

# 10

Reason LiveBench (old)

77.3%

# 30

ELO LMArena

1308

# 20

Math LiveBench (old)

59.2%

# 7

MATH

90.0%

# 16

MATH 500

90.0%

# 3

Human Eval

92.4%

# 1

Human Eval+

89.0%

# 10

NYT Connections

26.4%

# 6

MMLU Pro

80.3%

# 20

MMLU

85.0%

# 6

Halluc. Hughes

1.4%

# 6

Aidan Bench

1577

# 24

AIME 2024

63.6%

# 39

IF LiveBench (old)

65.4%

# 34

Avg LiveBench (old)

53.4%

Pricing

# 27

Input Cost /M

$3

# 32

Output Cost /M

$12

Additional Details

Model ID

o1-mini

Last Updated

3 months ago