GPT 4o mini

Latest

OpenAI

•

Proprietary

# 77

Released

Jul 18, 2024

# 15

Knowledge Cutoff

Oct 23

# 11

Context Length

128K

Benchmarks

# 107

Code RankedAGI

24.8%

# 49

Aider Polyglot

3.6%

# 28

LiveCodeBench v6

27.5%

# 40

Code LMArena

1245

# 40

Code LiveBench (old)

43.1%

# 79

GPQA Diamond

43.0%

# 43

Reason LiveBench (old)

35.3%

# 36

ELO LMArena

1272

# 41

Math LiveBench (old)

35.6%

# 23

MATH

75.0%

# 18

Human Eval

87.2%

# 8

Human Eval+

83.5%

# 32

NYT Connections

9.9%

# 52

MMLU Pro

63.1%

# 35

MMLU

82.0%

# 9

Halluc. Hughes

1.7%

# 48

IF LiveBench (old)

56.8%

# 50

Avg LiveBench (old)

43.3%

Pricing

# 11

Input Cost /M

$0.15

# 16

Output Cost /M

$0.6

Additional Details

Model ID

gpt-4o-mini

Last Updated

3 months ago