GPT 4o

Old

OpenAI

•

Proprietary

# 74

Released

Aug 6, 2024

# 15

Knowledge Cutoff

Oct 23

# 11

Context Length

128K

Benchmarks

# 87

Code RankedAGI

38.3%

# 26

LiveCodeBench v6

29.9%

# 37

Code LMArena

1251

# 24

Svelte Bench

17.8%

# 28

Code LiveBench (old)

51.4%

# 66

GPQA Diamond

51.0%

# 26

Reason LiveBench (old)

54.7%

# 40

ELO LMArena

1265

# 29

Math LiveBench (old)

48.2%

# 18

MATH

78.0%

# 34

Humanity Last Exam

3.1%

# 10

Human Eval

90.0%

# 3

Human Eval+

87.2%

# 18

NYT Connections

17.8%

# 27

MMLU Pro

74.7%

# 13

MMLU

89.0%

# 9

Aidan Bench

1333

# 34

IF LiveBench (old)

68.6%

# 32

Avg LiveBench (old)

55.1%

Pricing

# 29

Input Cost /M

$2.5

# 33

Output Cost /M

$10

Additional Details

Model ID

gpt-4o-2024-08-06

Last Updated

4 months ago