Model | Size | Version | Released | SWEBench Pro | SWEBench Verified | Terminal Bench 2.0 | BrowseComp | Code Arena | Svelte Bench | Coding Livebench | HLE | HLE w/ Tools | GPQA Diamond | Reason LiveBench | Text Arena | AIME 2025 I & II | Math LiveBench | MMLU | MMMU | Halluc. Hughes | IF LiveBench | Avg LiveBench | IF Evaluation | Input Cost /M | Output Cost /M | Cutoff Knowledge | Context Length | Org. | License | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Preview | Apr 7, 2026 | 77.8% | 93.9% | 82.0% | 86.9% | 56.8% | 64.7% | 94.6% | $25 | $125 | Anthropic | Proprietary | |||||||||||||||||
2 | 754B | Latest | Apr 7, 2026 | 58.4% | 69.0% | 68.0% | 91.1% | 31.0% | 52.3% | 86.2% | 1467 | $1.4 | $4.4 | 200K | Z.ai | Open Source | ||||||||||||||
3 | Latest | Feb 17, 2026 | 79.6% | 59.1% | 74.7% | 1462 | 93.3% | 33.2% | 49.0% | 89.9% | $3 | $15 | Anthropic | Proprietary | ||||||||||||||||
4 | 744B | Latest | Feb 12, 2026 | 77.8% | 56.2% | 1441 | 88.9% | 30.5% | 50.4% | 86.0% | Z.ai | Proprietary | ||||||||||||||||||
5 | Latest | Feb 5, 2026 | 65.4% | 84.0% | 1546 | 100.0% | 78.2% | 40.0% | 53.1% | $5 | $25 | 1M | Anthropic | Proprietary | ||||||||||||||||
6 | 1T | Latest | Jan 27, 2026 | 50.7% | 76.8% | 50.8% | 1429 | 90.0% | 77.9% | 30.1% | 50.2% | 87.6% | 96.1% | $0.6 | $3 | 256K | Moonshot | Open Source | ||||||||||||
7 | Latest | Nov 24, 2025 | 67.8% | 87.0% | Anthropic | Proprietary | ||||||||||||||||||||||||
8 | Latest | Sep 29, 2025 | 77.2% | 51.0% | 43.6% | 1491 | 93.3% | 80.4% | 17.7% | 33.6% | 83.4% | 87.0% | 77.8% | $3 | $15 | Anthropic | Proprietary | |||||||||||||
9 | Latest | Sep 5, 2025 | 69.2% | 90.0% | $0.6 | $2.5 | 256K | Moonshot | Open Source | |||||||||||||||||||||
10 | 840B | Latest | Aug 21, 2025 | 66.0% | 74.9% | 49.8% | 91.8% | $0.56 | $1.68 | 128K | DeepSeek | Open Source | ||||||||||||||||||
11 | 840B | Latest | Aug 21, 2025 | 15.9% | 80.1% | 88.4% | 93.7% | $0.56 | $1.68 | 128K | DeepSeek | Open Source | ||||||||||||||||||
12 | Latest | Aug 7, 2025 | 52.8% | 78.9% | 6.3% | 77.8% | 94.6% | 74.4% | $1.25 | $10 | Oct 24 | 400K | OpenAI | Proprietary | ||||||||||||||||
13 | Latest | Aug 7, 2025 | 71.0% | 21.1% | 82.3% | 91.1% | $0.25 | $2 | May 24 | 400K | OpenAI | Proprietary | ||||||||||||||||||
14 | Latest | Aug 7, 2025 | 54.7% | 16.7% | 71.2% | 85.2% | $0.05 | $0.4 | May 24 | 400K | OpenAI | Proprietary | ||||||||||||||||||
15 | Latest | Aug 7, 2025 | 42.0% | 89.4% | 100.0% | OpenAI | Proprietary | |||||||||||||||||||||||
16 | Latest | Aug 7, 2025 | 74.9% | 77.8% | 35.2% | 87.3% | 99.6% | 84.2% | OpenAI | Proprietary | ||||||||||||||||||||
17 | Latest | Aug 5, 2025 | 74.5% | 88.9% | 80.9% | 78.0% | 77.1% | $15 | $75 | Mar 25 | 200K | Anthropic | Proprietary | |||||||||||||||||
18 | 20B | Latest | Aug 5, 2025 | 20.0% | 17.3% | 71.5% | 98.7% | 85.3% | $0.1 | $0.5 | OpenAI | Open Source | ||||||||||||||||||
19 | 120B | Latest | Aug 5, 2025 | 35.6% | 19.0% | 80.1% | 97.9% | 90.0% | $0.15 | $0.75 | OpenAI | Open Source | ||||||||||||||||||
20 | Latest | Aug 1, 2025 | 34.8% | 99.2% | Proprietary | |||||||||||||||||||||||||
21 | 30B | Latest | Jul 30, 2025 | 73.4% | 85.0% | 91.4% | 88.9% | 1M | Alibaba | Open Source | ||||||||||||||||||||
22 | 30B | Latest | Jul 29, 2025 | 70.4% | 61.3% | 89.3% | 84.7% | 1M | Alibaba | Open Source | ||||||||||||||||||||
23 | 235B | Latest | Jul 25, 2025 | 57.8% | 18.2% | 81.1% | 92.3% | 87.8% | 256K | Alibaba | Open Source | |||||||||||||||||||
24 | 480B | Latest | Jul 22, 2025 | 67.0% | 67.8% | 256K | Alibaba | Open Source | ||||||||||||||||||||||
25 | 235B | Latest | Jul 21, 2025 | 55.6% | 77.5% | 70.3% | 88.7% | 262K | Alibaba | Open Source | ||||||||||||||||||||
26 | 32B | Latest | Jul 15, 2025 | 75.4% | 85.3% | 84.8% | Nov 24 | 128K | LG | Proprietary | ||||||||||||||||||||
27 | 1T | Old | Jul 11, 2025 | 71.6% | 84.4% | 4.7% | 75.1% | 63.0% | 49.5% | 74.4% | 89.5% | 82.5% | 62.7% | 89.8% | $0.6 | $2.5 | 131K | Moonshot | Open Source | |||||||||||
28 | Latest | Jul 10, 2025 | 61.6% | $0.4 | $2 | Mistral | Open Source | |||||||||||||||||||||||
29 | 24B | Latest | Jul 10, 2025 | 53.6% | 13.3% | $0.1 | $0.3 | Mistral | Open Source | |||||||||||||||||||||
30 | Latest | Jul 9, 2025 | 87.8% | 38.6% | 87.5% | 97.8% | 98.8% | 88.8% | 78.1% | 72.1% | $3 | $15 | 256K | xAI | Proprietary | |||||||||||||||
31 | Latest | Jul 9, 2025 | 44.4% | 88.9% | 100.0% | xAI | Proprietary | |||||||||||||||||||||||
32 | Latest | Jun 17, 2025 | 42.6% | 5.1% | 64.6% | 49.8% | 81.1% | 72.9% | $0.1 | $0.4 | Jan 25 | 1M | Proprietary | |||||||||||||||||
33 | Latest | Jun 17, 2025 | 44.9% | 6.9% | 66.7% | 63.1% | 84.5% | 72.9% | $0.1 | $0.4 | Jan 25 | 1M | Proprietary | |||||||||||||||||
34 | Latest | Jun 10, 2025 | 94.7% | 84.8% | 85.9% | 74.7% | $20 | $80 | Jun 24 | 200K | OpenAI | Proprietary | ||||||||||||||||||
35 | Latest | Jun 5, 2025 | 67.2% | 1443.22 | 81.1% | 21.6% | 86.4% | 93.7% | 1470 | 88.0% | 83.3% | 89.2% | 82.0% | 78.5% | 69.4% | $1.25 | $10 | Jan 25 | 1M | Proprietary | ||||||||||
36 | 685B | Latest | May 28, 2025 | 48.9% | 17.7% | 81.0% | 77.2% | 87.5% | 77.9% | 80.5% | 66.3% | DeepSeek | Open Source | |||||||||||||||||
37 | Latest | May 22, 2025 | 72.5% | 1411.98 | 88.9% | 10.7% | 83.3% | 56.4% | 1414 | 90.0% | 78.8% | 76.5% | 78.4% | 63.8% | $4 | $75 | Mar 25 | 200K | Anthropic | Proprietary | ||||||||||
38 | Latest | May 22, 2025 | 90.5% | 69.0% | 88.3% | 80.7% | 73.2% | $4 | $75 | Mar 25 | 200K | Anthropic | Proprietary | |||||||||||||||||
39 | Latest | May 22, 2025 | 72.7% | 1389.18 | 88.9% | 7.7% | 83.8% | 54.9% | 1390 | 85.0% | 76.4% | 74.4% | 77.3% | 62.4% | $3 | $15 | Mar 25 | 1M | Anthropic | Proprietary | ||||||||||
40 | Latest | May 22, 2025 | 95.3% | 85.3% | 80.4% | 72.9% | $3 | $15 | Mar 25 | 1M | Anthropic | Proprietary | ||||||||||||||||||
41 | Latest | May 20, 2025 | 60.4% | 11.0% | 82.8% | 78.5% | 1419 | 72.0% | 84.1% | 88.4% | 79.7% | 79.6% | 64.7% | $0.3 | $2.5 | Jan 25 | 1M | Proprietary | ||||||||||||
42 | Latest | May 7, 2025 | 72.2% | 1369 | 66.1% | 89.4% | $0.4 | $2 | Mistral | |||||||||||||||||||||
43 | Old | May 6, 2025 | 1408.2 | 81.1% | 88.3% | 1446 | 83.0% | 88.6% | 83.5% | 72.7% | 1M | Proprietary | ||||||||||||||||||
44 | 4B | Latest | Apr 29, 2025 | 54.2% | 55.9% | 65.6% | 2.7% | 32K | Alibaba | Open Source | ||||||||||||||||||||
45 | 32B | Latest | Apr 29, 2025 | 85.7% | 2.8% | 128K | Alibaba | Open Source | ||||||||||||||||||||||
46 | 30B | Old | Apr 29, 2025 | 34.4% | 65.8% | 70.9% | 128K | Alibaba | Open Source | |||||||||||||||||||||
47 | 235B | Old | Apr 29, 2025 | 81.5% | 128K | Alibaba | Open Source | |||||||||||||||||||||||
48 | Preview | Apr 17, 2025 | 1145.13 | 70.0% | 12.1% | 78.3% | 1400 | 78.0% | 88.4% | 76.7% | 1.3% | $0.15 | $0.6 | Jan 25 | 1M | Proprietary | ||||||||||||||
49 | Latest | Apr 16, 2025 | 69.1% | 1187.08 | 30.0% | 20.3% | 87.7% | 91.0% | 1443 | 88.9% | 80.7% | 6.8% | 84.3% | 72.4% | $2 | $8 | Jun 24 | 200K | OpenAI | Proprietary | ||||||||||
50 | Latest | Apr 16, 2025 | 93.3% | 89.2% | 85.0% | 80.7% | 75.6% | $2 | $8 | Jun 24 | 200K | OpenAI | Proprietary | |||||||||||||||||
51 | Latest | Apr 16, 2025 | 68.1% | 1093.02 | 13.3% | 18.1% | 81.4% | 78.5% | 1390 | 84.0% | 81.0% | 81.6% | 4.6% | 81.8% | 67.4% | $1.1 | $4.4 | Jun 24 | 200K | OpenAI | Proprietary | |||||||||
52 | Latest | Apr 16, 2025 | 88.1% | 91.7% | 84.9% | 85.0% | 73.3% | $1.1 | $4.4 | Jun 24 | 200K | OpenAI | Proprietary | |||||||||||||||||
53 | Latest | Apr 14, 2025 | 55.0% | 1261.35 | 22.2% | 66.3% | 1402 | 90.2% | 75.0% | 2.0% | 87.0% | $2 | $8 | Jun 24 | 1M | OpenAI | Proprietary | |||||||||||||
54 | Latest | Apr 14, 2025 | 24.0% | 1188.56 | 1.1% | 65.0% | 1365 | 87.5% | 73.0% | 2.2% | 84.0% | $0.4 | $1.6 | Jun 24 | 1M | OpenAI | Proprietary | |||||||||||||
55 | Latest | Apr 14, 2025 | 11.1% | 50.3% | 80.1% | 55.0% | 2.0% | 75.0% | $0.1 | $0.4 | Jun 24 | 1M | OpenAI | Proprietary | ||||||||||||||||
56 | 2T | Preview | Apr 5, 2025 | 73.7% | 85.8% | 76.1% | Aug 24 | Meta | Open Source | |||||||||||||||||||||
57 | 400B | Latest | Apr 5, 2025 | 1006.52 | 64.4% | 69.8% | 1273 | 84.6% | 73.4% | $0.19 | $0.49 | Aug 24 | 1M | Meta | Open Source | |||||||||||||||
58 | 109B | Latest | Apr 5, 2025 | 895.26 | 15.6% | 57.2% | 69.4% | Aug 24 | 10M | Meta | Open Source | |||||||||||||||||||
59 | Latest | Mar 26, 2025 | 25.6% | 1431 | 69.1% | $5 | $15 | Oct 23 | 128K | OpenAI | Proprietary | |||||||||||||||||||
60 | Old | Mar 25, 2025 | 63.8% | 1272.86 | 83.3% | 18.8% | 84.0% | 1443 | 86.7% | 89.8% | 81.7% | 1.1% | $1.25 | $10 | Jan 25 | 1M | Proprietary | |||||||||||||
61 | 685B | Latest | Mar 24, 2025 | 1209.23 | 68.4% | 1388 | 8.0% | $0.27 | $1.1 | Jul 24 | 128K | DeepSeek | Open Source | |||||||||||||||||
62 | 32B | Latest | Mar 24, 2025 | 46.0% | Alibaba | Open Source | ||||||||||||||||||||||||
63 | 32B | Latest | Mar 18, 2025 | 66.1% | 80.0% | 83.0% | LG | Proprietary | ||||||||||||||||||||||
64 | 7.8B | Latest | Mar 18, 2025 | 62.6% | 76.7% | 75.0% | LG | Proprietary | ||||||||||||||||||||||
65 | 2.4B | Latest | Mar 18, 2025 | 54.3% | 73.3% | 65.8% | LG | Proprietary | ||||||||||||||||||||||
66 | 24B | Latest | Mar 17, 2025 | 46.0% | 80.6% | 62.8% | 5.6% | 128K | Mistral | Open Source | ||||||||||||||||||||
67 | 111B | Latest | Mar 13, 2025 | 1310 | $2.5 | $10 | 256K | Cohere | Open Source | |||||||||||||||||||||
68 | 12B | Latest | Mar 12, 2025 | Open Source | ||||||||||||||||||||||||||
69 | 27B | Latest | Mar 12, 2025 | 11.1% | 42.4% | 1339 | 76.9% | 64.9% | 3.0% | Open Source | ||||||||||||||||||||
70 | 4B | Latest | Mar 12, 2025 | Open Source | ||||||||||||||||||||||||||
71 | 32B | Latest | Mar 5, 2025 | 1312 | 66.0% | 83.9% | $0.4 | $0.55 | Sep 24 | 131K | Alibaba | Open Source | ||||||||||||||||||
72 | Preview | Feb 27, 2025 | 38.0% | 71.4% | 1425 | 74.4% | 1.2% | $75 | $150 | 128K | OpenAI | Proprietary | ||||||||||||||||||
73 | Mercury Coder Mini | Preview | Feb 26, 2025 | Inception Labs | Proprietary | |||||||||||||||||||||||||
74 | Mercury Coder Small | Preview | Feb 26, 2025 | Inception Labs | Proprietary | |||||||||||||||||||||||||
75 | Preview | Feb 25, 2025 | Sep 24 | Alibaba | Open Source | |||||||||||||||||||||||||
76 | Latest | Feb 24, 2025 | 70.3% | 1355.76 | 56.7% | 8.0% | 68.0% | 1365 | 71.8% | 90.8% | $3 | $15 | Oct 24 | 200K | Anthropic | Proprietary | ||||||||||||||
77 | Latest | Feb 24, 2025 | 8.9% | 78.2% | 76.2% | 1363 | 49.5% | 79.0% | 75.0% | 81.3% | 66.9% | 93.2% | $3 | $15 | Oct 24 | 200K | Anthropic | Proprietary | ||||||||||||
78 | R1 1776 | Latest | Feb 18, 2025 | 90.5% | $2 | $8 | 128K | Perplexity | Open Source | |||||||||||||||||||||
79 | Latest | Feb 17, 2025 | 1148.53 | 83.3% | 75.4% | 1399 | 73.2% | 2.1% | $3 | $15 | Nov 24 | 130K | xAI | Proprietary | ||||||||||||||||
80 | Preview | Feb 17, 2025 | 84.6% | 93.3% | 78.0% | Nov 24 | 1M | xAI | Proprietary | |||||||||||||||||||||
81 | Latest | Feb 17, 2025 | 67.8% | 11.0% | 79.0% | 69.4% | 3.3% | $0.3 | $0.5 | Nov 24 | 130K | xAI | Proprietary | |||||||||||||||||
82 | Preview | Feb 17, 2025 | 84.0% | 90.8% | Nov 24 | 1M | xAI | Proprietary | ||||||||||||||||||||||
83 | Latest | Feb 5, 2025 | 1041.64 | 60.1% | 1357 | 27.5% | 71.7% | 0.7% | $0.1 | $0.4 | Aug 24 | 1M | Proprietary | |||||||||||||||||
84 | Latest | Feb 5, 2025 | 51.5% | 1306 | 68.0% | 1.2% | $0.075 | $0.3 | Aug 24 | 1M | Proprietary | |||||||||||||||||||
85 | Preview | Feb 5, 2025 | 1109.54 | 7.0% | 64.7% | 1379 | 27.5% | 72.7% | 0.8% | Aug 24 | 2M | Proprietary | ||||||||||||||||||
86 | Latest | Jan 31, 2025 | 49.3% | 1147.27 | 14.0% | 79.7% | 1355 | 86.5% | 86.9% | 0.8% | $1.1 | $4.4 | Oct 23 | 200K | OpenAI | Proprietary | ||||||||||||||
87 | Latest | Jan 31, 2025 | 40.8% | 70.6% | 48.0% | 84.9% | $1.1 | $4.4 | Oct 23 | 200K | OpenAI | Proprietary | ||||||||||||||||||
88 | Latest | Jan 31, 2025 | 42.9% | 1100.18 | 15.5% | 13.4% | 76.8% | 1305 | 76.5% | 85.9% | $1.1 | $4.4 | Oct 23 | 200K | OpenAI | Proprietary | ||||||||||||||
89 | 24B | Latest | Jan 30, 2025 | 45.3% | 81.0% | 3.1% | 82.9% | 32K | Mistral | Proprietary | ||||||||||||||||||||
90 | Old | Jan 29, 2025 | 1377 | $2.5 | $10 | Jun 24 | 128K | OpenAI | Proprietary | |||||||||||||||||||||
91 | Latest | Jan 28, 2025 | 981.52 | 60.1% | 1357 | $1.6 | $6.4 | Sep 24 | 32K | Alibaba | Proprietary | |||||||||||||||||||
92 | Preview | Jan 21, 2025 | 1034 | 7.2% | 74.2% | 1380 | 53.5% | 1.8% | Aug 24 | 1M | Proprietary | |||||||||||||||||||
93 | 671B | Latest | Jan 20, 2025 | 49.2% | 1205.21 | 8.6% | 71.5% | 1384 | 70.0% | 90.8% | 14.3% | 83.3% | $0.55 | $2.19 | Jul 24 | 128K | DeepSeek | Open Source | ||||||||||||
94 | 70B | Latest | Jan 20, 2025 | 6.0% | 65.2% | 55.0% | Dec 23 | DeepSeek | Open Source | |||||||||||||||||||||
95 | 8B | Latest | Jan 20, 2025 | 49.0% | Dec 24 | DeepSeek | Open Source | |||||||||||||||||||||||
96 | 32B | Latest | Jan 20, 2025 | 6.0% | 62.1% | Sep 24 | DeepSeek | Open Source | ||||||||||||||||||||||
97 | 14B | Latest | Jan 20, 2025 | 59.1% | 49.0% | Sep 24 | DeepSeek | Open Source | ||||||||||||||||||||||
98 | 7B | Latest | Jan 20, 2025 | 49.1% | 59.0% | Sep 24 | DeepSeek | Open Source | ||||||||||||||||||||||
99 | 1.5B | Latest | Jan 20, 2025 | 33.8% | 20.0% | Sep 24 | DeepSeek | Open Source | ||||||||||||||||||||||
100 | Latest | Jan 14, 2025 | 256K | Mistral | Proprietary | |||||||||||||||||||||||||
101 | Sky T1 Preview | 32B | Preview | Jan 11, 2025 | 56.8% | NovaSky | Open Source | |||||||||||||||||||||||
102 | 671B | Old | Dec 26, 2024 | 42.0% | 963.91 | 59.1% | 1315 | 25.0% | 88.5% | 3.9% | 86.1% | $0.07 | $1.1 | Jul 24 | 128K | DeepSeek | Open Source | |||||||||||||
103 | Old | Dec 19, 2024 | 1022 | 1369 | Aug 24 | 32K | Proprietary | |||||||||||||||||||||||
104 | Latest | Dec 17, 2024 | 41.0% | 1050.14 | 8.8% | 76.0% | 1388 | 79.0% | 2.4% | $15 | $60 | Oct 23 | 200K | OpenAI | Proprietary | |||||||||||||||
105 | Latest | Dec 17, 2024 | 0.832 | 11.1% | 79.0% | 2.4% | $150 | $600 | Oct 23 | 200K | OpenAI | Proprietary | ||||||||||||||||||
106 | 14B | Latest | Dec 12, 2024 | 56.1% | 84.8% | 63.0% | Microsoft | Open Source | ||||||||||||||||||||||
107 | Old | Dec 11, 2024 | 51.8% | 984 | 62.1% | 1356 | 87.0% | 1.3% | Aug 24 | 1M | Proprietary | |||||||||||||||||||
108 | Old | Dec 10, 2024 | 1258 | 2.4% | Nov 23 | 128K | DeepSeek | Proprietary | ||||||||||||||||||||||
109 | Old | Dec 6, 2024 | 1022.51 | 1379 | Aug 24 | 2M | Proprietary | |||||||||||||||||||||||
110 | 70B | Latest | Dec 6, 2024 | 50.5% | 1257 | 86.0% | 4.0% | 92.1% | $0.1 | $0.4 | Dec 23 | Meta | Open Source | |||||||||||||||||
111 | Latest | Dec 3, 2024 | 42.0% | 1217 | 79.0% | 1.8% | $0.06 | $0.24 | 300K | Amazon | Proprietary | |||||||||||||||||||
112 | Latest | Dec 3, 2024 | 40.0% | 1198 | 76.0% | 1.6% | $0.04 | $0.14 | 128K | Amazon | Proprietary | |||||||||||||||||||
113 | Latest | Dec 3, 2024 | 46.9% | 1245 | 84.0% | 1.8% | 92.1% | $0.8 | $3.2 | 300K | Amazon | Proprietary | ||||||||||||||||||
114 | 32B | Preview | Nov 28, 2024 | 65.2% | 33.5% | 12.9% | Sep 24 | 32K | Alibaba | Open Source | ||||||||||||||||||||
115 | Old | Nov 21, 2024 | 1365 | Aug 24 | 32K | Proprietary | ||||||||||||||||||||||||
116 | Old | Nov 20, 2024 | 31.0% | 964 | 39.0% | 1361 | 13.0% | 86.0% | 1.5% | 84.6% | $2.5 | $10 | Nov 23 | 128K | OpenAI | Proprietary | ||||||||||||||
117 | Preview | Nov 20, 2024 | 58.5% | DeepSeek | Proprietary | |||||||||||||||||||||||||
118 | 123B | Latest | Nov 18, 2024 | 47.0% | 1251 | 84.0% | 4.1% | $2 | $6 | Jul 24 | 128K | Mistral | Proprietary | |||||||||||||||||
119 | 123B | Latest | Nov 18, 2024 | 52.0% | 85.0% | 6.6% | $2 | $6 | 128K | Mistral | Proprietary | |||||||||||||||||||
120 | Latest | Nov 15, 2024 | Sep 24 | 1M | Alibaba | Proprietary | ||||||||||||||||||||||||
121 | Old | Nov 14, 2024 | 1343 | Aug 24 | 32K | Proprietary | ||||||||||||||||||||||||
122 | 32B | Latest | Nov 12, 2024 | 903.59 | 41.0% | 1220 | 79.0% | $0.2 | $0.2 | Sep 24 | 128K | Alibaba | Open Source | |||||||||||||||||
123 | 14B | Latest | Nov 12, 2024 | Sep 24 | 128K | Alibaba | Open Source | |||||||||||||||||||||||
124 | 7B | Latest | Nov 12, 2024 | Sep 24 | 128K | Alibaba | Open Source | |||||||||||||||||||||||
125 | 3B | Latest | Nov 12, 2024 | Sep 24 | 32K | Alibaba | Open Source | |||||||||||||||||||||||
126 | 1.5B | Latest | Nov 12, 2024 | Sep 24 | 32K | Alibaba | Open Source | |||||||||||||||||||||||
127 | 0.5B | Latest | Nov 12, 2024 | Sep 24 | 32K | Alibaba | Open Source | |||||||||||||||||||||||
128 | Latest | Oct 22, 2024 | 40.6% | 1134.43 | 73.3% | 41.6% | 1239 | 81.0% | 4.9% | $1 | $5 | Jul 24 | 200K | Anthropic | Proprietary | |||||||||||||||
129 | Latest | Oct 22, 2024 | 49.0% | 1245.4 | 4.8% | 65.0% | 1355 | 3.0% | 88.0% | 70.4% | 4.6% | 89.3% | $3 | $15 | Apr 24 | 200K | Anthropic | Proprietary | ||||||||||||
130 | 3B | Latest | Sep 25, 2024 | 21.0% | 1093 | 63.4% | 7.9% | $0.08 | $0.1 | Dec 23 | 128K | Meta | Open Source | |||||||||||||||||
131 | 1B | Latest | Sep 25, 2024 | 14.0% | 1044 | 49.3% | 20.7% | $0.04 | $0.08 | Dec 23 | 128K | Meta | Open Source | |||||||||||||||||
132 | 90B | Latest | Sep 25, 2024 | 43.0% | 86.0% | 4.3% | $0.9 | $0.9 | Dec 23 | 128K | Meta | Open Source | ||||||||||||||||||
133 | 11B | Latest | Sep 25, 2024 | 26.0% | 73.0% | 5.5% | $0.19 | $0.19 | Dec 23 | 128K | Meta | Open Source | ||||||||||||||||||
134 | 8B | Old | Sep 24, 2024 | 38.4% | 1177 | $0.0375 | $0.15 | Sep 24 | 1M | Proprietary | ||||||||||||||||||||
135 | Old | Sep 24, 2024 | 51.0% | 1269 | 81.0% | 3.4% | $0.075 | $0.3 | Sep 24 | 1M | Proprietary | |||||||||||||||||||
136 | Old | Sep 24, 2024 | 893.34 | 59.1% | 1301 | 86.0% | 6.6% | 81.9% | $1.25 | $2.5 | Sep 24 | 2M | Proprietary | |||||||||||||||||
137 | 7B | Latest | Sep 19, 2024 | 2.8% | Sep 24 | 128K | Alibaba | Open Source | ||||||||||||||||||||||
138 | 72B | Latest | Sep 19, 2024 | 23.8% | 49.0% | 1259 | 86.8% | 4.7% | $0.38 | $0.57 | Sep 24 | 128K | Alibaba | Open Source | ||||||||||||||||
139 | 32B | Latest | Sep 19, 2024 | 49.5% | 83.9% | 3.0% | 79.5% | Sep 24 | 128K | Alibaba | Open Source | |||||||||||||||||||
140 | 14B | Latest | Sep 19, 2024 | 45.5% | 80.0% | 4.2% | 81.0% | Sep 24 | 128K | Alibaba | Open Source | |||||||||||||||||||
141 | 1.5B | Latest | Sep 19, 2024 | 15.8% | Sep 24 | 32K | Alibaba | Open Source | ||||||||||||||||||||||
142 | 0.5B | Latest | Sep 19, 2024 | 25.2% | Sep 24 | 32K | Alibaba | Open Source | ||||||||||||||||||||||
143 | 3B | Latest | Sep 19, 2024 | 7.0% | Sep 24 | 32K | Alibaba | Open Source | ||||||||||||||||||||||
144 | 236B | Old | Sep 12, 2024 | 42.0% | 1221 | 81.0% | $0.14 | $0.28 | Nov 23 | 128K | DeepSeek | Proprietary | ||||||||||||||||||
145 | Latest | Sep 12, 2024 | 35.0% | 1053.69 | 60.0% | 1308 | 85.0% | 1.4% | $3 | $12 | Oct 23 | 128K | OpenAI | Proprietary | ||||||||||||||||
146 | Old | Sep 12, 2024 | 41.0% | 73.3% | 1372 | 91.0% | 3.3% | $15 | $60 | Oct 23 | 128K | OpenAI | Proprietary | |||||||||||||||||
147 | Old | Aug 27, 2024 | 1227 | 6.6% | Nov 23 | 1M | Proprietary | |||||||||||||||||||||||
148 | Old | Aug 27, 2024 | 1260 | 9.1% | Nov 23 | 2M | Proprietary | |||||||||||||||||||||||
149 | Latest | Aug 13, 2024 | 3.9% | 56.0% | 1290 | 87.5% | 4.6% | $5 | $15 | Aug 24 | 128K | xAI | Proprietary | |||||||||||||||||
150 | Latest | Aug 13, 2024 | 51.0% | 1266 | 86.2% | Aug 24 | 128K | xAI | Proprietary | |||||||||||||||||||||
151 | Old | Aug 6, 2024 | 17.8% | 3.1% | 51.0% | 1265 | 89.0% | $2.5 | $10 | Oct 23 | 128K | OpenAI | Proprietary | |||||||||||||||||
152 | 2B | Latest | Jul 31, 2024 | 51.3% | 7.0% | Jun 24 | 8K | Open Source | ||||||||||||||||||||||
153 | 123B | Old | Jul 24, 2024 | 48.0% | 1250 | 85.0% | 4.1% | $2 | $6 | Jul 24 | 128K | Mistral | Proprietary | |||||||||||||||||
154 | 12B | Latest | Jul 24, 2024 | 33.0% | 68.0% | 11.2% | $0.15 | $0.15 | Apr 24 | 128K | Mistral | Proprietary | ||||||||||||||||||
155 | 70B | Old | Jul 23, 2024 | 43.0% | 1242 | 86.0% | 5.0% | 87.5% | $1 | $3 | Dec 23 | 128K | Meta | Open Source | ||||||||||||||||
156 | 405B | Latest | Jul 23, 2024 | 24.5% | 811.91 | 51.1% | 1266 | 87.0% | 3.9% | 88.6% | $5 | $15 | Dec 23 | 128K | Meta | Open Source | ||||||||||||||
157 | 8B | Latest | Jul 23, 2024 | 27.0% | 1171 | 71.0% | 5.4% | $0.3 | $0.6 | Dec 23 | 128K | Meta | Open Source | |||||||||||||||||
158 | 236B | Latest | Jul 22, 2024 | 42.0% | 1213 | 80.0% | $0.14 | $0.28 | Nov 23 | 128K | DeepSeek | Proprietary | ||||||||||||||||||
159 | Latest | Jul 18, 2024 | 43.0% | 1272 | 82.0% | 1.7% | $0.15 | $0.6 | Oct 23 | 128K | OpenAI | Proprietary | ||||||||||||||||||
160 | 27B | Latest | Jun 27, 2024 | 1220 | 75.2% | Jun 24 | 8K | Open Source | ||||||||||||||||||||||
161 | 9B | Latest | Jun 27, 2024 | 71.3% | 10.1% | Jun 24 | 8K | Open Source | ||||||||||||||||||||||
162 | Old | Jun 20, 2024 | 33.4% | 59.4% | 1268 | 88.7% | 68.3% | $3 | $15 | Apr 24 | 200K | Anthropic | Proprietary | |||||||||||||||||
163 | Old | Mar 7, 2024 | 33.3% | 1179 | 75.2% | $0.25 | $1.25 | Aug 23 | 200K | Anthropic | Proprietary | |||||||||||||||||||
164 | Latest | Mar 4, 2024 | 22.0% | 50.4% | 1248 | 84.0% | 10.1% | $15 | $75 | Aug 23 | 200K | Anthropic | Proprietary |