GPT 4o mini

Latest

OpenAI

•

Proprietary

# 60

Released

Jul 18, 2024

# 12

Knowledge Cutoff

Oct 23

# 9

Context Length

128K

Benchmarks

# 86

Code RankedAGI

24.1%

# 35

Code LiveBench

25.5%

# 36

Aider Polyglot

3.6%

# 35

Code LMArena

1245

# 40

Code LiveBench 24.11

43.1%

# 60

GPQA Diamond

43.0%

# 43

Reason LiveBench

35.3%

# 31

ELO LMArena

1272

# 41

Math LiveBench

35.6%

# 23

MATH

75.0%

# 18

Human Eval

87.2%

# 8

Human Eval+

83.5%

# 32

NYT Connections

9.9%

# 46

MMLU Pro

63.1%

# 26

MMLU

82.0%

# 9

Halluc. Hughes

1.7%

# 48

IF LiveBench

56.8%

# 43

Data LiveBench

44.5%

# 48

Lang LiveBench

28.6%

# 50

Avg LiveBench

43.3%

Pricing

# 11

Input Cost /M

$0.15

# 17

Output Cost /M

$0.6

Additional Details

Model ID

gpt-4o-mini

Last Updated

about 2 months ago