GPT 4o

Old

OpenAI

•

Proprietary

# 42

Released

Nov 20, 2024

# 11

Knowledge Cutoff

Nov 23

# 9

Context Length

128K

Benchmarks

# 72

Code RankedAGI

32.6%

# 27

Code LiveBench

35.2%

# 29

Aider Polyglot

18.2%

# 19

SWEBench Verified

31.0%

# 26

WebDev Arena

964

# 16

Code LMArena

1306

# 37

Code LiveBench 24.11

46.1%

# 64

GPQA Diamond

39.0%

# 27

Reason LiveBench

53.3%

# 11

ELO LMArena

1361

# 30

AIME 2025 I & II

13.0%

# 36

Math LiveBench

42.5%

# 31

MATH

69.0%

# 10

Human Eval

90.0%

# 16

NYT Connections

18.7%

# 20

MMLU Pro

74.7%

# 16

MMLU

86.0%

# 7

Halluc. Hughes

1.5%

# 10

Aidan Bench

1269

# 41

IF LiveBench

64.9%

# 39

Data LiveBench

47.2%

# 20

Lang LiveBench

47.4%

# 36

Avg LiveBench

53.2%

# 10

IF Evaluation

84.6%

Pricing

# 26

Input Cost /M

$2.5

# 31

Output Cost /M

$10

Additional Details

Model ID

gpt-4o-2024-11-20

Last Updated

about 1 month ago