GPT 4o

Old

OpenAI

•

Proprietary

# 35

Released

Nov 20, 2024

# 10

Knowledge Cutoff

Nov 23

# 7

Context Length

128K

Benchmarks

# 36

Code LiveBench

46.1%

# 19

Aider Polyglot

18.2%

# 15

SWEBench Verified

31.0%

# 18

WebDev Arena

964

# 14

Code LMArena

1306

# 56

GPQA Diamond

39.0%

# 26

Reason LiveBench

53.3%

# 11

ELO LMArena

1361

# 22

AIME 2025 I & II

13.0%

# 35

Math LiveBench

42.5%

# 31

MATH

69.0%

# 9

Human Eval

90.0%

# 16

NYT Connections

18.7%

# 6

Aider Old

72.9%

# 17

MMLU Pro

74.7%

# 14

MMLU

86.0%

# 6

Halluc. Hughes

1.5%

# 10

Aidan Bench

1269

# 41

IF LiveBench

64.9%

# 39

Data LiveBench

47.2%

# 19

Lang LiveBench

47.4%

# 35

Avg LiveBench

53.2%

# 8

IF Evaluation

84.6%

Pricing

# 25

Input Cost /M

$2.5

# 27

Output Cost /M

$10

Additional Details

Model ID

gpt-4o-2024-11-20

Last Updated

3 days ago