GPT 4o
OldOpenAI
•
Proprietary# 107
Released
Nov 20, 2024
# 18
Knowledge Cutoff
Nov 23
# 13
Context Length
128K
Benchmarks
# 173
Code RankedAGI
31.6%
# 56
SWEBench Verified
31.0%
# 178
Agentic RankedAGI
27.8%
# 14
Code LMArena
1306
# 34
Aider Polyglot
18.2%
# 34
Code LiveBench (old)
46.1%
# 174
Reason RankedAGI
34.1%
# 110
GPQA Diamond
39.0%
# 51
Text Arena
1361
# 53
AIME 2025 I & II
13.0%
# 10
Human Eval
90.0%
# 23
NYT Connections
18.7%
# 34
MMLU Pro
74.7%
# 20
MMLU
86.0%
# 8
Halluc. Hughes
1.5%
# 10
Aidan Bench
1269
# 33
Avg LiveBench (old)
53.2%
# 14
IF Evaluation
84.6%
# 24
Coding LiveBench 25.4
35.2%
# 36
Data LiveBench
47.2%
# 19
Language LiveBench
47.4%
# 12
Quality Artificial Analysis
71
# 196
Math RankedAGI
38.2%
# 177
RAGI RankedAGI
37.6%
Pricing
# 38
Input Cost /M
$2.5
# 43
Output Cost /M
$10
Additional Details
Model ID
gpt-4o-2024-11-20
Last Updated
about 2 months ago