Model
Size
Version
Released
Code
RankedAGI
Coding
LiveBench
Aider
Polyglot
SWEBench
Verified
WebDev
Arena
LiveCodeBench
v6
Codeforces
ELO
Code
LMArena
GPQA
Diamond
Reason
LiveBench
ELO
LMArena
AIME
2025 I & II
Math
LiveBench
Humanity
Last Exam
MMLU
MMMU
Halluc.
Hughes
AIME
2024
IF
LiveBench
Avg
LiveBench
IF
Evaluation
Input
Cost /M
Output
Cost /M
Cutoff
Knowledge
Context
Length
Org.
License
1
OpenAI logo o3 highLatestApr 16, 202577.6%76.7%79.6%76.1%93.3%89.2%85.0%80.7%75.6%$2$8Jun 24200KOpenAIProprietary
2
OpenAI logo o4 mini highLatestApr 16, 202577.5%80.0%72.0%81.1%88.1%91.7%84.9%85.0%73.3%$1.1$4.4Jun 24200KOpenAIProprietary
3
OpenAI logo o3LatestApr 16, 202574.1%77.9%69.1%1187.0875.5%2706146087.7%91.0%144388.9%80.7%20.3%6.8%91.6%84.3%72.4%$2$8Jun 24200KOpenAIProprietary
4
Google logo Gemini 2.5 ProOldMay 6, 202573.0%72.9%76.9%1408.268.1%144688.3%144683.0%88.6%83.5%72.7%1MGoogleProprietary
5
DeepSeek logo DeepSeek R1LatestMay 28, 202572.5%76.1%73.9%81.0%77.2%87.5%77.9%17.7%91.4%80.5%66.3%DeepSeekOpen Source
6
Google logo Gemini 2.5 ProLatestJun 5, 202572.4%70.7%83.1%67.2%1443.2269.0%149686.4%93.7%147088.0%83.3%21.6%89.2%82.0%78.5%69.4%$1.25$10Jan 251MGoogleProprietary
7
Google logo Gemini 2.5 ProOldMar 25, 202570.2%72.9%63.8%1272.86135284.0%144386.7%18.8%89.8%81.7%1.1%92.0%$1.25$10Jan 251MGoogleProprietary
8
Anthropic logo Claude 4 OpusLatestMay 22, 202569.0%73.6%70.7%79.4%1411.9848.4%145683.3%56.4%141490.0%78.8%10.7%76.5%78.4%63.8%$4$75Mar 25200KAnthropicProprietary
9
Anthropic logo Claude 4 Opus ThinkingLatestMay 22, 202568.6%73.3%72.0%58.4%90.5%69.0%88.3%80.7%73.2%$4$75Mar 25200KAnthropicProprietary
10
Alibaba logo QWQ MaxPreviewFeb 25, 202568.2%Sep 24AlibabaOpen Source
11
OpenAI logo o3 mini highLatestJan 31, 202567.4%60.4%49.3%1147.2768.9%2130133279.7%135586.5%14.0%86.9%0.8%87.3%$1.1$4.4Oct 23200KOpenAIProprietary
12
xAI logo Grok 3 (Think)PreviewFeb 17, 202567.4%84.6%93.3%78.0%93.3%Nov 241MxAIProprietary
13
Anthropic logo Claude 4 SonnetLatestMay 22, 202566.7%78.3%56.4%80.2%1389.1848.4%143283.8%54.9%139085.0%76.4%7.7%74.4%77.3%62.4%$3$15Mar 25200KAnthropicProprietary
14
Alibaba logo Qwen 3 A22B235BLatestApr 29, 202566.0%61.8%67.5%205681.5%85.7%128KAlibabaOpen Source
15
OpenAI logo o4 miniLatestApr 16, 202565.0%74.2%68.1%1093.022719133481.4%78.5%139084.0%81.0%18.1%81.6%4.6%81.8%67.4%$1.1$4.4Jun 24200KOpenAIProprietary
16
Anthropic logo Claude 4 Sonnet ThinkingLatestMay 22, 202564.5%73.6%61.3%57.0%95.3%85.3%80.4%72.9%$3$15Mar 25200KAnthropicProprietary
17
Alibaba logo Qwen 3 A3B30BLatestApr 29, 202562.6%197465.8%70.9%80.4%128KAlibabaOpen Source
18
Google logo Gemini 2.5 FlashLatestMay 20, 202562.1%62.8%61.9%60.4%62.0%143382.8%78.5%141972.0%84.1%11.0%88.4%79.7%79.6%64.7%$0.3$2.5Jan 251MGoogleProprietary
19
OpenAI logo o1LatestDec 17, 202461.9%61.7%41.0%1050.141891133176.0%138879.0%8.8%2.4%83.3%$15$60Oct 23200KOpenAIProprietary
20
OpenAI logo GPT 4oLatestMar 26, 202561.4%45.3%1457143169.1%$5$15Oct 23128KOpenAIProprietary
21
Anthropic logo Claude 3.7 Sonnet ThinkingLatestFeb 24, 202560.4%73.2%64.9%133378.2%76.2%136349.5%79.0%8.9%75.0%80.0%81.3%66.9%93.2%$3$15Oct 24200KAnthropicProprietary
22
OpenAI logo o3 mini mediumLatestJan 31, 202559.9%53.8%42.9%1100.1864.3%2036130976.8%130576.5%13.4%85.9%79.6%$1.1$4.4Oct 23200KOpenAIProprietary
23
LG logo EXAONE Deep32BLatestMar 18, 202559.5%66.1%80.0%83.0%90.0%LGProprietary
24
OpenAI logo o1 ProLatestDec 17, 202458.7%61.7%0.832191479.0%2.4%86.0%$150$600Oct 23200KOpenAIProprietary
25
OpenAI logo GPT 4.5PreviewFeb 27, 202558.6%45.0%38.0%136271.4%142574.4%1.2%36.7%$75$150128KOpenAIProprietary
26
Anthropic logo Claude 3.7 SonnetLatestFeb 24, 202557.7%60.4%70.3%1355.76132668.0%13658.0%71.8%23.3%90.8%$3$15Oct 24200KAnthropicProprietary
27
Google logo Gemini 2.5 FlashPreviewApr 17, 202557.2%51.1%1145.1378.3%140078.0%12.1%88.4%76.7%1.3%88.0%$0.15$0.6Jan 251MGoogleProprietary
28
DeepSeek logo DeepSeek R1671BLatestJan 20, 202556.8%56.9%49.2%1205.212029134271.5%138470.0%8.6%90.8%14.3%83.3%$0.55$2.19Jul 24128KDeepSeekOpen Source
29
OpenAI logo o3 mini lowLatestJan 31, 202556.4%40.8%58.6%183170.6%48.0%84.9%60.0%$1.1$4.4Oct 23200KOpenAIProprietary
30
LG logo EXAONE Deep7.8BLatestMar 18, 202555.2%62.6%76.7%75.0%83.3%LGProprietary
31
Alibaba logo Qwen 34BLatestApr 29, 202554.2%54.2%167155.9%65.6%2.7%73.8%32KAlibabaOpen Source
32
Google logo Gemini 2 Flash ThinkingOldDec 19, 202453.1%1023.3612831369Aug 2432KGoogleProprietary
33
Google logo Gemini Exp 1114OldNov 14, 202452.4%1343Aug 2432KGoogleProprietary
34
Alibaba logo Qwen 332BLatestApr 29, 202551.4%40.0%197785.7%2.8%81.4%128KAlibabaOpen Source
35
xAI logo Grok 3 miniLatestFeb 17, 202551.3%34.7%67.9%79.0%11.0%69.4%3.3%93.0%$0.3$0.5Nov 24130KxAIProprietary
36
Google logo Gemini Exp 1206OldDec 6, 202450.8%38.2%1022.511379Aug 242MGoogleProprietary
37
Google logo Gemini Exp 1121OldNov 21, 202450.4%1365Aug 2432KGoogleProprietary
38
OpenAI logo GPT 4.1LatestApr 14, 202550.3%53.0%55.0%1261.3566.3%140290.2%75.0%2.0%48.1%87.0%$2$8Jun 241MOpenAIProprietary
39
DeepSeek logo DeepSeek V3685BLatestMar 24, 202549.8%55.1%1209.2329.0%134368.4%13888.0%59.4%$0.27$1.1Jul 24128KDeepSeekOpen Source
40
Google logo Gemini 2.0 ProPreviewFeb 5, 202549.4%1109.54129864.7%137927.5%7.0%72.7%0.8%Aug 242MGoogleProprietary
41
Alibaba logo QwQ32BLatestMar 5, 202549.2%20.9%1291131266.0%79.5%83.9%$0.4$0.55Sep 24131KAlibabaOpen Source
42
Meta logo Llama 4 Behemoth2TPreviewApr 5, 202549.0%73.7%85.8%76.1%Aug 24MetaOpen Source
43
DeepSeek logo R1 Distill Llama70BLatestJan 20, 202548.8%163365.2%55.0%6.0%70.0%Dec 23DeepSeekOpen Source
44
OpenAI logo o1 PreviewOldSep 12, 202448.7%41.0%1258131273.3%137291.0%3.3%56.7%$15$60Oct 23128KOpenAIProprietary
45
DeepSeek logo Deepseek V3671BOldDec 26, 202448.6%48.4%42.0%963.911134127959.1%131525.0%88.5%3.9%86.1%$0.07$1.1Jul 24128KDeepSeekOpen Source
46
Mistral logo Mistral Large123BOldJul 24, 202447.1%124448.0%125085.0%4.1%$2$6Jul 24128KMistralProprietary
47
Anthropic logo Claude 3.5 SonnetLatestOct 22, 202446.6%51.6%49.0%1245.436.4%717131365.0%13553.0%4.8%88.0%70.4%4.6%16.0%89.3%$3$15Apr 24200KAnthropicProprietary
48
LG logo EXAONE Deep2.4BLatestMar 18, 202546.6%54.3%73.3%65.8%76.7%LGProprietary
49
Google logo Gemini 1.5 Pro 002OldSep 24, 202445.8%893.34125359.1%130186.0%6.6%81.9%$1.25$2.5Sep 242MGoogleProprietary
50
xAI logo Grok 3LatestFeb 17, 202545.3%53.3%1148.53133575.4%139973.2%2.1%52.2%$3$15Nov 24130KxAIProprietary
51
xAI logo Grok 2LatestAug 13, 202445.1%125356.0%12903.9%87.5%4.6%$5$15Aug 24128KxAIProprietary
52
OpenAI logo o1 miniLatestSep 12, 202444.9%32.9%35.0%1053.691650129260.0%130885.0%1.4%63.6%$3$12Oct 23128KOpenAIProprietary
53
Google logo Gemini 2 Flash ThinkingPreviewJan 21, 202544.6%1034.54129074.2%138053.5%7.2%1.8%Aug 241MGoogleProprietary
54
Anthropic logo Claude 3.5 SonnetOldJun 20, 202444.0%33.4%128259.4%126888.7%68.3%$3$15Apr 24200KAnthropicProprietary
55
OpenAI logo GPT 4oOldJan 29, 202543.8%27.1%13311377$2.5$10Jun 24128KOpenAIProprietary
56
Mistral logo Mistral Large123BLatestNov 18, 202442.7%122847.0%125184.0%4.1%$2$6Jul 24128KMistralProprietary
57
DeepSeek logo R1 Distill Qwen32BLatestJan 20, 202542.6%169162.1%6.0%72.6%Sep 24DeepSeekOpen Source
58
Google logo Gemini 2.0 Flash ExpOldDec 11, 202442.5%22.2%51.8%983.97129062.1%135687.0%1.3%Aug 241MGoogleProprietary
59
DeepSeek logo DeepSeek Coder 2236BLatestJul 22, 202441.5%122642.0%121380.0%$0.14$0.28Nov 23128KDeepSeekProprietary
60
Google logo Gemini 1.5 Pro 001OldAug 27, 202440.9%124412609.1%Nov 232MGoogleProprietary
61
Google logo Gemini 1.5 Flash 001OldAug 27, 202440.6%120812276.6%Nov 231MGoogleProprietary
62
Alibaba logo QwQ Preview32BPreviewNov 28, 202440.2%65.2%33.5%12.9%44.0%Sep 2432KAlibabaOpen Source
63
Google logo Gemini 2.0 FlashLatestFeb 5, 202540.1%1041.64127160.1%135727.5%71.7%0.7%$0.1$0.4Aug 241MGoogleProprietary
64
Alibaba logo Qwen 2.5 MaxLatestJan 28, 202540.0%21.8%981.52129160.1%1357$0.0016$0.0064Sep 2432KAlibabaProprietary
65
Anthropic logo Claude 3.5 HaikuLatestOct 22, 202440.0%28.0%40.6%1134.43126341.6%123981.0%4.9%$1$5Jul 24200KAnthropicProprietary
66
Google logo Gemini 1.5 Flash 002OldSep 24, 202439.3%121051.0%126981.0%3.4%$0.075$0.3Sep 241MGoogleProprietary
67
Alibaba logo Qwen 2.57BLatestSep 19, 202438.4%2.8%Sep 24128KAlibabaOpen Source
68
OpenAI logo GPT 4oOldAug 6, 202438.3%29.9%125151.0%12653.1%89.0%$2.5$10Oct 23128KOpenAIProprietary
69
Alibaba logo Qwen 2.572BLatestSep 19, 202438.0%23.8%124749.0%125986.8%4.7%$0.38$0.57Sep 24128KAlibabaOpen Source
70
xAI logo Grok-2 miniLatestAug 13, 202437.5%123051.0%126686.2%Aug 24128KxAIProprietary
71
Amazon logo Nova ProLatestDec 3, 202437.1%122846.9%124584.0%1.8%92.1%$0.8$3.2300KAmazonProprietary
72
Meta logo Llama 3.370BLatestDec 6, 202436.6%123250.5%125786.0%4.0%92.1%$0.1$0.4Dec 23MetaOpen Source
73
Google logo Gemma 227BLatestJun 27, 202435.9%1203122075.2%Jun 248KGoogleOpen Source
74
OpenAI logo GPT 4.1 miniLatestApr 14, 202535.5%35.0%24.0%1188.5665.0%136587.5%73.0%2.2%49.6%84.0%$0.4$1.6Jun 241MOpenAIProprietary
75
Google logo Gemini 2.5 Flash Lite ThinkingLatestJun 17, 202535.5%27.1%44.9%34.3%66.7%63.1%6.9%84.5%72.9%$0.1$0.4Jan 251MGoogleProprietary
76
Google logo Gemini 2.5 Flash LiteLatestJun 17, 202534.4%26.7%42.6%33.7%64.6%49.8%5.1%81.1%72.9%$0.1$0.4Jan 251MGoogleProprietary
77
Google logo Gemini 2.0 Flash-LiteLatestFeb 5, 202533.6%124651.5%130668.0%1.2%$0.075$0.3Aug 241MGoogleProprietary
78
Meta logo Llama 4 Scout109BLatestApr 5, 202532.8%895.2657.2%69.4%Aug 2410MMetaOpen Source
79
Meta logo Llama 3.170BOldJul 23, 202432.7%120943.0%124286.0%5.0%87.5%$1$3Dec 23128KMetaOpen Source
80
OpenAI logo GPT 4oOldNov 20, 202432.6%18.2%31.0%964130639.0%136113.0%86.0%1.5%84.6%$2.5$10Nov 23128KOpenAIProprietary
81
Alibaba logo Qwen 2.5 Coder32BLatestNov 12, 202432.4%8.0%903.59122741.0%122079.0%$0.2$0.2Sep 24128KAlibabaOpen Source
82
Meta logo Llama 3.1405BLatestJul 23, 202432.1%24.5%811.91126051.1%126687.0%3.9%88.6%$5$15Dec 23128KMetaOpen Source
83
DeepSeek logo DeepSeek 2.5236BOldSep 12, 202432.1%17.8%125542.0%122181.0%$0.14$0.28Nov 23128KDeepSeekProprietary
84
Anthropic logo Claude 3 OpusLatestMar 4, 202430.3%22.0%123650.4%124884.0%10.1%$15$75Aug 23200KAnthropicProprietary
85
Google logo Gemini 1.5 Flash8BOldSep 24, 202428.7%116738.4%1177$0.0375$0.15Sep 241MGoogleProprietary
86
Mistral logo Mistral Nemo12BLatestJul 24, 202428.7%33.0%68.0%11.2%$0.15$0.15Apr 24128KMistralProprietary
87
Meta logo Llama 4 Maverick400BLatestApr 5, 202528.2%16.0%1006.52126569.8%127384.6%73.4%$0.19$0.49Aug 241MMetaOpen Source
88
Amazon logo Nova LiteLatestDec 3, 202427.5%120042.0%121779.0%1.8%$0.06$0.24300KAmazonProprietary
89
Alibaba logo Qwen 2.532BLatestSep 19, 202427.0%49.5%83.9%3.0%79.5%Sep 24128KAlibabaOpen Source
90
Mercury Coder SmallPreviewFeb 26, 202525.0%Inception LabsProprietary
91
OpenAI logo GPT 4o miniLatestJul 18, 202424.8%3.6%27.5%124543.0%127282.0%1.7%$0.15$0.6Oct 23128KOpenAIProprietary
92
Alibaba logo Qwen 2.5 Coder14BLatestNov 12, 202423.4%Sep 24128KAlibabaOpen Source
93
Google logo Gemma 29BLatestJun 27, 202422.5%118071.3%10.1%Jun 248KGoogleOpen Source
94
Anthropic logo Claude 3 HaikuOldMar 7, 202422.3%19.6%118433.3%117975.2%$0.25$1.25Aug 23200KAnthropicProprietary
95
Mistral logo Codestral 25.01LatestJan 14, 202521.9%11.1%256KMistralProprietary
96
Alibaba logo Qwen 2.514BLatestSep 19, 202420.9%45.5%80.0%4.2%81.0%Sep 24128KAlibabaOpen Source
97
Alibaba logo Qwen 2.5 Coder7BLatestNov 12, 202420.3%Sep 24128KAlibabaOpen Source
98
Amazon logo Nova MicroLatestDec 3, 202420.2%118140.0%119876.0%1.6%$0.04$0.14128KAmazonProprietary
99
Meta logo Llama 3.18BLatestJul 23, 202419.7%117427.0%117171.0%5.4%$0.3$0.6Dec 23128KMetaOpen Source
100
Google logo Gemma 312BLatestMar 12, 202519.1%GoogleOpen Source
101
OpenAI logo GPT 4.1 nanoLatestApr 14, 202517.6%10.0%50.3%80.1%55.0%2.0%29.4%75.0%$0.1$0.4Jun 241MOpenAIProprietary
102
Mercury Coder MiniPreviewFeb 26, 202517.0%Inception LabsProprietary
103
Google logo Gemma 327BLatestMar 12, 202515.2%4.9%124442.4%133976.9%64.9%3.0%GoogleOpen Source
104
Google logo Gemma 34BLatestMar 12, 202511.7%GoogleOpen Source
105
Alibaba logo Qwen 2.5 Coder3BLatestNov 12, 202410.8%Sep 2432KAlibabaOpen Source
106
Alibaba logo Qwen 2.5 Coder1.5BLatestNov 12, 20246.1%Sep 2432KAlibabaOpen Source
107
Alibaba logo Qwen 2.51.5BLatestSep 19, 20244.7%15.8%Sep 2432KAlibabaOpen Source
108
Alibaba logo Qwen 2.5 Coder0.5BLatestNov 12, 20242.0%Sep 2432KAlibabaOpen Source
109
Alibaba logo Qwen 2.50.5BLatestSep 19, 20242.0%25.2%Sep 2432KAlibabaOpen Source
110
DeepSeek logo R1 Distill Qwen14BLatestJan 20, 2025148159.1%49.0%69.7%Sep 24DeepSeekOpen Source
111
DeepSeek logo R1 Lite PreviewPreviewNov 20, 2024145058.5%52.5%DeepSeekProprietary
112
DeepSeek logo R1 Distill Llama8BLatestJan 20, 2025120549.0%50.4%Dec 24DeepSeekOpen Source
113
DeepSeek logo R1 Distill Qwen7BLatestJan 20, 2025118949.1%59.0%55.5%Sep 24DeepSeekOpen Source
114
DeepSeek logo R1 Distill Qwen1.5BLatestJan 20, 202595433.8%20.0%28.9%Sep 24DeepSeekOpen Source
115
xAI logo Grok 3 mini (Think)PreviewFeb 17, 202584.0%90.8%95.8%Nov 241MxAIProprietary
116
Sky T1 Preview32BPreviewJan 11, 202556.8%43.3%NovaSkyOpen Source
117
Microsoft logo Phi 414BLatestDec 12, 202456.1%84.8%63.0%MicrosoftOpen Source
118
Mistral logo Pixtral Large123BLatestNov 18, 202452.0%85.0%6.6%$2$6128KMistralProprietary
119
Alibaba logo Qwen 2.5 VL32BLatestMar 24, 202546.0%AlibabaOpen Source
120
Mistral logo Mistral Small 3.124BLatestMar 17, 202546.0%80.6%62.8%5.6%128KMistralOpen Source
121
Mistral logo Mistral Small 324BLatestJan 30, 202545.3%81.0%3.1%82.9%32KMistralProprietary
122
Meta logo Llama 3.2 (Vision)90BLatestSep 25, 202443.0%86.0%4.3%$0.9$0.9Dec 23128KMetaOpen Source
123
Meta logo Llama 3.2 (Vision)11BLatestSep 25, 202426.0%73.0%5.5%$0.19$0.19Dec 23128KMetaOpen Source
124
Meta logo Llama 3.23BLatestSep 25, 2024104821.0%109363.4%7.9%$0.08$0.1Dec 23128KMetaOpen Source
125
Meta logo Llama 3.21BLatestSep 25, 2024100914.0%104449.3%20.7%$0.04$0.08Dec 23128KMetaOpen Source
126
OpenAI logo o3 ProLatestJun 10, 2025$20$80Jun 24200KOpenAIProprietary
127
Mistral logo Mistral Medium 3LatestMay 7, 2025136966.1%89.4%$0.4$2Mistral
128
Cohere logo Command A111BLatestMar 13, 202512881310$2.5$10256KCohereOpen Source
129
R1 1776LatestFeb 18, 202590.5%81.0%$2$8128KPerplexityOpen Source
130
DeepSeek logo Deepseek 2.5OldDec 10, 2024126212582.4%Nov 23128KDeepSeekProprietary
131
Alibaba logo Qwen 2.5 TurboLatestNov 15, 2024Sep 241MAlibabaProprietary
132
Alibaba logo Qwen 2.53BLatestSep 19, 20247.0%Sep 2432KAlibabaOpen Source
133
Google logo Gemma 22BLatestJul 31, 202451.3%7.0%Jun 248KGoogleOpen Source
133 models