Loading...
Loading...
Top 20 models ranked by output speed (tok/s)
| Rank | Model | Output Speed (tok/s) |
|---|---|---|
| 🥇 | Inception | 859 tok/s |
| 🥈 | IBM | 509 tok/s |
| 🥉 | IBM | 499 tok/s |
| 4 | NVIDIA | 429 tok/s |
| 5 | 396 tok/s | |
| 6 | Amazon | 336 tok/s |
| 7 | 322 tok/s | |
| 8 | Sarvam | 311 tok/s |
| 9 | OpenAI | 306 tok/s |
| 10 | OpenAI | 304 tok/s |
| 11 | 281 tok/s | |
| 12 | OpenAI | 277 tok/s |
| 13 | OpenAI | 273 tok/s |
| 14 | 271 tok/s | |
| 15 | OpenAI | 270 tok/s |
| 16 | Mistral | 261 tok/s |
| 17 | Mistral | 261 tok/s |
| 18 | 260 tok/s | |
| 19 | OpenAI | 249 tok/s |
| 20 | Liquid AI | 228 tok/s |