---
title: "Claude 3 Haiku Benchmarks - RankedAGI"
description: "Detailed benchmark and metadata record for Claude 3 Haiku."
source: "https://rankedagi.com/models/claude-3-haiku-old"
---

# Claude 3 Haiku

| Field | Value |
| --- | --- |
| Organization | Anthropic |
| License | Proprietary |
| Version | Old |
| Released | 2024-03-07 |
| Context window | 200K |
| Knowledge cutoff | 2023-08-01 |
| Input cost per million tokens | $0.25 |
| Output cost per million tokens | $1.25 |
| Model ID | claude-3-haiku-20240307 |
| Last updated | 2025-06-06 05:45:30.731799+00 |

## Benchmarks

| Benchmark | Category | Value | Description | Source |
| --- | --- | --- | --- | --- |
| RankedAGI Coding | coding | 21.9% | RankedAGI Coding Score |  |
| RankedAGI Agentic | Agents | 21.2% | RankedAGI Agentic Score |  |
| LiveCodeBench v6 | coding | 19.6% | LiveCodeBench v6 - Evaluation of Large Language Models for Code |  |
| LiveCodeBench v5 | coding | 22.2% | LiveCodeBench - Evaluation of Large Language Models for Code |  |
| ChatArena (LMSYS) | coding | 1184 | ChatArena (LMSYS) Coding ELO Score with Style Control |  |
| LiveBench Coding Score (old) | coding | 24.5% | LiveBench Coding Score old version |  |
| RankedAGI Reasoning | reasoning | 26.6% | RankedAGI Reasoning Score |  |
| GPQA Diamond | reasoning | 33.3% | Generalized Prefix Question Answering Score (Reasoning) PhD Level Reasoning |  |
| Text Arena | general | 1179 | ChatArena (LMSYS) ELO Score | https://arena.ai/leaderboard/text |
| HumanEval | coding | 75.9% | HumanEval coding benchmark |  |
| NYT Connections Extended | reasoning | 2.2% | NYT Connections Extended Version | https://github.com/lechmazur/nyt-connections/ |
| MMLU Pro | knowledge | 42.3% | Graduate-level visual problem-solving |  |
| MMLU | knowledge | 75.2% | Image Reasoning |  |
| Artificial Analysis Quality Index | general | 54 | Artificial Analysis Quality Index (third-party composite, deprecated) |  |
| RankedAGI Math | math | 38.3% | RankedAGI Math Score |  |
| RankedAGI Overall | general | 32.4% | Overall RankedAGI score |  |