---
title: "Claude 3.5 Sonnet Benchmarks - RankedAGI"
description: "Detailed benchmark and metadata record for Claude 3.5 Sonnet."
source: "https://rankedagi.com/models/claude-3.5-sonnet-old"
---

# Claude 3.5 Sonnet

| Field | Value |
| --- | --- |
| Organization | Anthropic |
| License | Proprietary |
| Version | Old |
| Released | 2024-06-20 |
| Context window | 200K |
| Knowledge cutoff | 2024-04-01 |
| Input cost per million tokens | $3 |
| Output cost per million tokens | $15 |
| Model ID | claude-3-5-sonnet-20240620 |
| Last updated | 2025-04-16 22:14:46.146909+00 |

## Benchmarks

| Benchmark | Category | Value | Description | Source |
| --- | --- | --- | --- | --- |
| RankedAGI Coding | coding | 34.5% | RankedAGI Coding Score |  |
| SWEBench Verified | coding | 33.4% | Agentic Coding | https://www.swebench.com/index.html |
| RankedAGI Agentic | Agents | 28.8% | RankedAGI Agentic Score |  |
| LiveCodeBench v5 | coding | 36.0% | LiveCodeBench - Evaluation of Large Language Models for Code |  |
| ChatArena (LMSYS) | coding | 1282 | ChatArena (LMSYS) Coding ELO Score with Style Control |  |
| LiveBench Coding Score (old) | coding | 60.9% | LiveBench Coding Score old version |  |
| RankedAGI Reasoning | reasoning | 38.1% | RankedAGI Reasoning Score |  |
| GPQA Diamond | reasoning | 59.4% | Generalized Prefix Question Answering Score (Reasoning) PhD Level Reasoning |  |
| Text Arena | general | 1268 | ChatArena (LMSYS) ELO Score | https://arena.ai/leaderboard/text |
| HumanEval | coding | 92.0% | HumanEval coding benchmark |  |
| HumanEval+ | coding | 81.7% | HumanEval+ benchmark |  |
| MMLU Pro | knowledge | 76.1% | Graduate-level visual problem-solving |  |
| MMLU | knowledge | 88.7% | Image Reasoning |  |
| MMMU | imaging | 68.3% | Multimodal Understanding College-level visual problem-solving |  |
| AidanBench | general | 1439 | AidanBench Score |  |
| LiveBench Average | general | 59.7% | LiveBench Average Score old version |  |
| LiveBench Data Analysis | general | 56.7% | LiveBench Data Analysis Score | https://livebench.ai/ |
| LiveBench Language | general | 53.2% | LiveBench Language Score | https://livebench.ai/ |
| Artificial Analysis Quality Index | general | 76 | Artificial Analysis Quality Index (third-party composite, deprecated) |  |
| RankedAGI Math | math | 45.0% | RankedAGI Math Score |  |
| RankedAGI Overall | general | 39.5% | Overall RankedAGI score |  |

## Model Links

| Title | URL |
| --- | --- |
| Release | https://www.anthropic.com/news/claude-3-5-sonnet |