GPT 4o

Old

OpenAI

•

Proprietary

# 62

Released

Nov 20, 2024

# 14

Knowledge Cutoff

Nov 23

# 11

Context Length

128K

Benchmarks

# 99

Code RankedAGI

32.6%

# 42

Aider Polyglot

18.2%

# 37

SWEBench Verified

31.0%

# 29

WebDev Arena

964

# 21

Code LMArena

1306

# 37

Code LiveBench (old)

46.1%

# 86

GPQA Diamond

39.0%

# 27

Reason LiveBench (old)

53.3%

# 21

ELO LMArena

1361

# 55

AIME 2025 I & II

13.0%

# 36

Math LiveBench (old)

42.5%

# 31

MATH

69.0%

# 10

Human Eval

90.0%

# 16

NYT Connections

18.7%

# 26

MMLU Pro

74.7%

# 23

MMLU

86.0%

# 7

Halluc. Hughes

1.5%

# 10

Aidan Bench

1269

# 41

IF LiveBench (old)

64.9%

# 36

Avg LiveBench (old)

53.2%

# 16

IF Evaluation

84.6%

Pricing

# 29

Input Cost /M

$2.5

# 33

Output Cost /M

$10

Additional Details

Model ID

gpt-4o-2024-11-20

Last Updated

6 months ago