Mistral Large

Old

Mistral

•

Proprietary

•

123B

# 56

Released

Jul 24, 2024

# 7

Knowledge Cutoff

Jul 24

# 9

Context Length

128K

Benchmarks

# 40

Code RankedAGI

47.1%

# 36

Code LMArena

1244

# 35

Code LiveBench 24.11

47.1%

# 51

GPQA Diamond

48.0%

# 38

Reason LiveBench

42.0%

# 41

ELO LMArena

1250

# 34

Math LiveBench

43.7%

# 27

MATH

72.0%

# 7

Human Eval

91.3%

# 22

Human Eval+

62.2%

# 40

MMLU Pro

65.9%

# 19

MMLU

85.0%

# 19

Halluc. Hughes

4.1%

# 36

IF LiveBench

67.9%

# 46

Data LiveBench

44.0%

# 33

Lang LiveBench

39.4%

# 40

Avg LiveBench

50.4%

Pricing

# 25

Input Cost /M

$2

# 29

Output Cost /M

$6