Google logo

Gemma 3

Latest

Google

Open Source

27B
# 76

Released

Mar 12, 2025

chart

Benchmarks

# 204

Code RankedAGI

24.5%

# 200

Agentic RankedAGI

23.2%

# 48

LiveCodeBench v6

14.0%

# 41

Code LMArena

1244

# 50

Aider Polyglot

4.9%

# 198

Reason RankedAGI

30.0%

# 73

HLE

5.0%

# 115

GPQA Diamond

42.4%

# 54

Text Arena

1339

# 62

AIME 2025 I & II

21.0%

# 17

Human Eval

87.8%

# 35

NYT Connections

11.8%

# 53

MMLU Pro

67.5%

# 41

MMLU

76.9%

# 31

MMMU

64.9%

# 19

Halluc. Hughes

3.0%

# 30

IF Evaluation

32.0%

# 39

Coding LiveBench 25.4

25.4%

# 22

MMMU Pro

48.0%

# 196

Math RankedAGI

41.2%

# 203

RAGI RankedAGI

34.4%

# 24

𝜏²-Bench Telecom

11.0%

# 29

Svelte Bench v1

11.1%

sparkle-2

Additional Details

Model ID

gemma-3-27b-it

Last Updated

about 2 months ago