o1 mini
LatestOpenAI
•
Proprietary# 116
Released
Sep 12, 2024
# 19
Knowledge Cutoff
Oct 23
# 14
Context Length
128K
Benchmarks
# 126
Code RankedAGI
40.8%
# 54
SWEBench Verified
35.0%
# 145
Agentic RankedAGI
34.4%
# 8
LiveCodeBench v5
68.4%
# 16
Code LMArena
1292
# 18
Codeforces ELO
1650
# 27
Aider Polyglot
32.9%
# 31
Code LiveBench (old)
48.0%
# 123
Reason RankedAGI
42.2%
# 75
GPQA Diamond
60.0%
# 66
Text Arena
1308
# 23
AIME 2024
63.6%
# 3
Human Eval
92.4%
# 1
Human Eval+
89.0%
# 17
NYT Connections
26.4%
# 22
MMLU Pro
80.3%
# 23
MMLU
85.0%
# 7
Halluc. Hughes
1.4%
# 6
Aidan Bench
1577
# 31
Avg LiveBench (old)
53.4%
# 26
Data LiveBench
54.1%
# 26
Language LiveBench
40.9%
# 4
Quality Artificial Analysis
82
# 122
Math RankedAGI
53.5%
# 133
RAGI RankedAGI
43.4%
Pricing
# 39
Input Cost /M
$3
# 44
Output Cost /M
$12
Additional Details
Model ID
o1-mini
Last Updated
about 2 months ago