GPT 4o

Old

OpenAI

•

Proprietary

# 54

Released

Aug 6, 2024

# 12

Knowledge Cutoff

Oct 23

# 9

Context Length

128K

Benchmarks

# 53

Code RankedAGI

41.6%

# 31

Code LiveBench

31.8%

# 32

Code LMArena

1251

# 28

Code LiveBench 24.11

51.4%

# 44

GPQA Diamond

51.0%

# 26

Reason LiveBench

54.7%

# 35

ELO LMArena

1265

# 29

Math LiveBench

48.2%

# 18

MATH

78.0%

# 10

Human Eval

90.0%

# 3

Human Eval+

87.2%

# 18

NYT Connections

17.8%

# 21

MMLU Pro

74.7%

# 6

MMLU

89.0%

# 9

Aidan Bench

1333

# 34

IF LiveBench

68.6%

# 30

Data LiveBench

52.9%

# 18

Lang LiveBench

47.6%

# 32

Avg LiveBench

55.1%

Pricing

# 26

Input Cost /M

$2.5

# 31

Output Cost /M

$10

Additional Details

Model ID

gpt-4o-2024-08-06

Last Updated

about 1 month ago