GPT 4o
OldOpenAI
•
Proprietary# 75
Released
Nov 20, 2024
# 16
Knowledge Cutoff
Nov 23
# 13
Context Length
128K
Benchmarks
# 45
Code RankedAGI
49.2%
# 47
SWEBench Verified
31.0%
# 42
Code Arena
964
# 21
Code LMArena
1306
# 43
Aider Polyglot
18.2%
# 37
Code LiveBench (old)
46.1%
# 124
Reason RankedAGI
38.9%
# 99
GPQA Diamond
39.0%
# 27
Reason LiveBench (old)
53.3%
# 24
Text Arena
1361
# 58
AIME 2025 I & II
13.0%
# 10
Human Eval
90.0%
# 24
NYT Connections
18.7%
# 28
MMLU Pro
74.7%
# 23
MMLU
86.0%
# 8
Halluc. Hughes
1.5%
# 10
Aidan Bench
1269
# 36
Avg LiveBench (old)
53.2%
# 17
IF Evaluation
84.6%
# 32
Coding LiveBench 25.4
35.2%
# 39
Data LiveBench
47.2%
# 20
Language LiveBench
47.4%
# 12
Quality Artificial Analysis
71
# 86
Math RankedAGI
29.5%
# 152
RAGI Overall
40.7%
Pricing
# 31
Input Cost /M
$2.5
# 35
Output Cost /M
$10
Additional Details
Model ID
gpt-4o-2024-11-20
Last Updated
about 1 year ago