xAI logo

Grok 2

Latest

xAI

Proprietary
# 118

Released

Aug 13, 2024

# 12

Knowledge Cutoff

Aug 24

# 14

Context Length

128K

chart

Benchmarks

# 182

Code RankedAGI

29.9%

# 188

Agentic RankedAGI

26.0%

# 29

Code LMArena

1253

# 35

Code LiveBench (old)

45.1%

# 174

Reason RankedAGI

35.2%

# 69

HLE

3.9%

# 82

GPQA Diamond

56.0%

# 60

Text Arena

1335

# 14

Human Eval

88.4%

# 13

Human Eval+

80.5%

# 32

MMLU Pro

75.5%

# 15

MMLU

87.5%

# 27

Halluc. Hughes

4.6%

# 17

Aidan Bench

826

# 30

Avg LiveBench (old)

54.4%

# 31

Data LiveBench

50.3%

# 24

Language LiveBench

43.2%

# 13

Quality Artificial Analysis

70

# 159

Math RankedAGI

45.9%

# 178

RAGI RankedAGI

37.5%

coins

Pricing

# 41

Input Cost /M

$5

# 46

Output Cost /M

$15