Google logo

Gemma 3

Latest

Google

Open Source

27B
# 69

Released

Mar 12, 2025

chart

Benchmarks

# 144

Code RankedAGI

17.8%

# 46

LiveCodeBench v6

14.0%

# 41

Code LMArena

1244

# 50

Aider Polyglot

4.9%

# 175

Reason RankedAGI

31.5%

# 68

HLE

5.0%

# 111

GPQA Diamond

42.4%

# 35

Text Arena

1339

# 59

AIME 2025 I & II

21.0%

# 17

Human Eval

87.8%

# 35

NYT Connections

11.8%

# 52

MMLU Pro

67.5%

# 42

MMLU

76.9%

# 31

MMMU

64.9%

# 19

Halluc. Hughes

3.0%

# 28

IF Evaluation

32.0%

# 39

Coding LiveBench 25.4

25.4%

# 20

MMMU Pro

48.0%

# 92

Math RankedAGI

34.7%

# 202

RAGI RankedAGI

37.0%

# 21

𝜏²-Bench Telecom

11.0%

# 29

Svelte Bench v1

11.1%

sparkle-2

Additional Details

Model ID

gemma-3-27b-it

Last Updated

3 days ago