o1 mini
LatestOpenAI
•
Proprietary# 104
Released
Sep 12, 2024
# 19
Knowledge Cutoff
Oct 23
# 13
Context Length
128K
Benchmarks
# 58
Code RankedAGI
60.2%
# 59
SWEBench Verified
35.0%
# 79
Agentic RankedAGI
42.7%
# 55
Code Arena
1053.69
# 10
LiveCodeBench v5
68.4%
# 23
Code LMArena
1292
# 22
Codeforces ELO
1650
# 36
Aider Polyglot
32.9%
# 34
Code LiveBench (old)
48.0%
# 113
Reason RankedAGI
48.8%
# 81
GPQA Diamond
60.0%
# 39
Text Arena
1308
# 29
AIME 2024
63.6%
# 3
Human Eval
92.4%
# 1
Human Eval+
89.0%
# 19
NYT Connections
26.4%
# 22
MMLU Pro
80.3%
# 27
MMLU
85.0%
# 7
Halluc. Hughes
1.4%
# 6
Aidan Bench
1577
# 34
Avg LiveBench (old)
53.4%
# 29
Data LiveBench
54.1%
# 28
Language LiveBench
40.9%
# 4
Quality Artificial Analysis
82
# 65
Math RankedAGI
56.4%
# 95
RAGI RankedAGI
50.1%
Pricing
# 38
Input Cost /M
$3
# 42
Output Cost /M
$12
Additional Details
Model ID
o1-mini
Last Updated
about 1 year ago