GPT 4o
OldOpenAI
•
Proprietary# 108
Released
Nov 20, 2024
# 18
Knowledge Cutoff
Nov 23
# 14
Context Length
128K
Benchmarks
# 177
Code RankedAGI
30.6%
# 56
SWEBench Verified
31.0%
# 181
Agentic RankedAGI
27.7%
# 14
Code LMArena
1306
# 34
Aider Polyglot
18.2%
# 34
Code LiveBench (old)
46.1%
# 176
Reason RankedAGI
34.3%
# 110
GPQA Diamond
39.0%
# 51
Text Arena
1361
# 54
AIME 2025 I & II
13.0%
# 10
Human Eval
90.0%
# 23
NYT Connections
18.7%
# 34
MMLU Pro
74.7%
# 20
MMLU
86.0%
# 8
Halluc. Hughes
1.5%
# 10
Aidan Bench
1269
# 33
Avg LiveBench (old)
53.2%
# 14
IF Evaluation
84.6%
# 25
Coding LiveBench 25.4
35.2%
# 36
Data LiveBench
47.2%
# 19
Language LiveBench
47.4%
# 12
Quality Artificial Analysis
71
# 198
Math RankedAGI
38.6%
# 179
RAGI RankedAGI
37.4%
Pricing
# 38
Input Cost /M
$2.5
# 43
Output Cost /M
$10
Additional Details
Model ID
gpt-4o-2024-11-20
Last Updated
about 2 months ago