Grok 2

Latest

xAI

•

Proprietary

# 46

Released

Aug 13, 2024

# 5

Knowledge Cutoff

Aug 24

# 7

Context Length

128K

Benchmarks

# 37

Code LiveBench

45.1%

# 28

Code LMArena

1253

# 32

GPQA Diamond

56.0%

# 41

Reason LiveBench

36.3%

# 27

ELO LMArena

1290

# 32

Math LiveBench

45.8%

# 22

MATH

76.1%

# 13

Human Eval

88.4%

# 13

Human Eval+

80.5%

# 20

Aider Old

58.6%

# 15

MMLU Pro

75.5%

# 9

MMLU

87.5%

# 21

Halluc. Hughes

4.6%

# 17

Aidan Bench

826

# 30

IF LiveBench

69.6%

# 34

Data LiveBench

50.3%

# 25

Lang LiveBench

43.2%

# 32

Avg LiveBench

54.4%

Pricing

# 27

Input Cost /M

$5

# 29

Output Cost /M

$15