---
title: "o1 Preview Benchmarks - RankedAGI"
description: "Detailed benchmark and metadata record for o1 Preview."
source: "https://rankedagi.com/models/o1-preview"
---

# o1 Preview

| Field | Value |
| --- | --- |
| Organization | OpenAI |
| License | Proprietary |
| Version | Old |
| Released | 2024-09-12 |
| Context window | 128K |
| Knowledge cutoff | 2023-10-01 |
| Input cost per million tokens | $15 |
| Output cost per million tokens | $60 |
| Model ID | o1-preview |
| Last updated | 2026-05-04T00:11:22.887Z |

## Benchmarks

| Benchmark | Category | Value | Description | Source |
| --- | --- | --- | --- | --- |
| RankedAGI Coding | coding | 47.9% | RankedAGI Coding Score |  |
| SWEBench Verified | coding | 41.0% | Agentic Coding | https://www.swebench.com/index.html |
| RankedAGI Agentic | Agents | 41.6% | RankedAGI Agentic Score |  |
| LiveCodeBench v5 | coding | 55.6% | LiveCodeBench - Evaluation of Large Language Models for Code |  |
| ChatArena (LMSYS) | coding | 1312 | ChatArena (LMSYS) Coding ELO Score with Style Control |  |
| Codeforces ELO Score | coding | 1258 | Codeforces ELO Score |  |
| LiveBench Coding Score (old) | coding | 50.8% | LiveBench Coding Score old version |  |
| RankedAGI Reasoning | reasoning | 49.2% | RankedAGI Reasoning Score |  |
| GPQA Diamond | reasoning | 73.3% | Generalized Prefix Question Answering Score (Reasoning) PhD Level Reasoning |  |
| Text Arena | general | 1388 | ChatArena (LMSYS) ELO Score | https://arena.ai/leaderboard/text |
| AIME 2024 | math | 56.7% | AIME 2024 Competition Math |  |
| HumanEval | coding | 92.4% | HumanEval coding benchmark |  |
| HumanEval+ | coding | 89.0% | HumanEval+ benchmark |  |
| MMLU | knowledge | 91.0% | Image Reasoning |  |
| Hughes Hallucination Evaluation | safety | 3.3% | Computed using Vectara's Hallucination Evaluation Model, also known as HHEM. This evaluates how often an LLM introduces hallucinations when summarizing a document. | https://github.com/vectara/hallucination-leaderboard |
| AidanBench | general | 1892 | AidanBench Score |  |
| LiveBench Average | general | 69.1% | LiveBench Average Score old version |  |
| LiveBench Data Analysis | general | 64.0% | LiveBench Data Analysis Score | https://livebench.ai/ |
| LiveBench Language | general | 68.7% | LiveBench Language Score | https://livebench.ai/ |
| Artificial Analysis Quality Index | general | 85 | Artificial Analysis Quality Index (third-party composite, deprecated) |  |
| RankedAGI Math | math | 56.3% | RankedAGI Math Score |  |
| RankedAGI Overall | general | 48.3% | Overall RankedAGI score |  |