GPT 4o

Old

OpenAI

•

Proprietary

# 59

Released

Aug 6, 2024

# 13

Knowledge Cutoff

Oct 23

# 9

Context Length

128K

Benchmarks

# 67

Code RankedAGI

38.3%

# 19

LiveCodeBench v6

29.9%

# 37

Code LMArena

1251

# 28

Code LiveBench (old)

51.4%

# 50

GPQA Diamond

51.0%

# 26

Reason LiveBench (old)

54.7%

# 40

ELO LMArena

1265

# 29

Math LiveBench (old)

48.2%

# 18

MATH

78.0%

# 23

Humanity Last Exam

3.1%

# 10

Human Eval

90.0%

# 3

Human Eval+

87.2%

# 18

NYT Connections

17.8%

# 20

MMLU Pro

74.7%

# 7

MMLU

89.0%

# 9

Aidan Bench

1333

# 34

IF LiveBench (old)

68.6%

# 32

Avg LiveBench (old)

55.1%

Pricing

# 26

Input Cost /M

$2.5

# 31

Output Cost /M

$10

Additional Details

Model ID

gpt-4o-2024-08-06

Last Updated

25 days ago