Grok 2

Latest

xAI

•

Proprietary

# 58

Released

Aug 13, 2024

# 7

Knowledge Cutoff

Aug 24

# 9

Context Length

128K

Benchmarks

# 50

Code RankedAGI

45.1%

# 36

Code LMArena

1253

# 38

Code LiveBench (old)

45.1%

# 44

GPQA Diamond

56.0%

# 42

Reason LiveBench (old)

36.3%

# 34

ELO LMArena

1290

# 33

Math LiveBench (old)

45.8%

# 22

MATH

76.1%

# 22

Humanity Last Exam

3.9%

# 14

Human Eval

88.4%

# 13

Human Eval+

80.5%

# 17

MMLU Pro

75.5%

# 12

MMLU

87.5%

# 26

Halluc. Hughes

4.6%

# 17

Aidan Bench

826

# 30

IF LiveBench (old)

69.6%

# 33

Avg LiveBench (old)

54.4%

Pricing

# 29

Input Cost /M

$5

# 33

Output Cost /M

$15