| 🔢 Nomic Embed Text | FP16 | 224 tok/s | 200 tok/s
+12%
| 0.3 GB | LM Studio | community | 2026-02-10 |
| 👁️ SmolVLM 500M | FP16 | 222 tok/s | 200 tok/s
+11%
| 1.2 GB | Jan | community | 2026-05-12 |
| 🔢 BGE Small | FP16 | 221 tok/s | 200 tok/s
+11%
| 0.1 GB | Ollama | community | 2026-02-23 |
Whisper Tiny | FP16 | 221 tok/s | 200 tok/s
+11%
| 0.1 GB | Xybrid CLI | community | 2026-04-20 |
Ternary Bonsai 1.7B | Q2 | 220 tok/s | 200 tok/s
+10%
| 0.5 GB | Xybrid CLI | community | 2026-03-17 |
Ternary Bonsai 8B | Q2 | 220 tok/s | 200 tok/s
+10%
| 1.8 GB | Ollama | community | 2026-05-11 |
| 🔢 GTE Large | FP16 | 220 tok/s | 200 tok/s
+10%
| 0.7 GB | LM Studio | community | 2026-02-11 |
Ternary Bonsai 4B | Q2 | 219 tok/s | 200 tok/s
+10%
| 1.0 GB | Xybrid CLI | community | 2026-03-16 |
SmolLM2 360M | FP16 | 218 tok/s | 200 tok/s
+9%
| 1.0 GB | Ollama | community | 2026-03-01 |
| 🎨 Stable Diffusion Turbo | FP16 | 214 tok/s | 200 tok/s
+7%
| 2.5 GB | LM Studio | community | 2026-01-16 |
Gemma 3 1B | FP16 | 213 tok/s | 200 tok/s
+7%
| 2.4 GB | Xybrid CLI | community | 2026-01-04 |
Bonsai Image 4B | Q2 | 212 tok/s | 200 tok/s
+6%
| 2.1 GB | Jan | community | 2026-02-09 |
| 🔢 all-MiniLM-L6-v2 | FP16 | 209 tok/s | 200 tok/s
+5%
| 0.1 GB | LM Studio | community | 2026-05-07 |
| 🗣️ OuteTTS 0.3 500M | FP16 | 209 tok/s | 200 tok/s
+5%
| 1.2 GB | Xybrid CLI | community | 2026-02-07 |
| 🗣️ KittenTTS Mini | FP16 | 209 tok/s | 200 tok/s
+5%
| 0.2 GB | Piper | editorial | 2026-05-10 |
Llama 3.2 1B | FP16 | 207 tok/s | 200 tok/s
+4%
| 3.3 GB | Xybrid CLI | community | 2026-05-25 |
Whisper Medium | FP16 | 206 tok/s | 200 tok/s
+3%
| 1.7 GB | MacWhisper | editorial | 2026-05-11 |
Qwen 2.5 0.5B | FP16 | 202 tok/s | 200 tok/s
+1%
| 1.4 GB | LM Studio | community | 2026-04-06 |
| 🗣️ Kokoro 82M | FP16 | 198 tok/s | 200 tok/s
-1%
| 0.4 GB | Piper | community | 2026-02-07 |
Wav2Vec2 Base | FP16 | 197 tok/s | 200 tok/s
-1%
| 0.3 GB | Xybrid CLI | community | 2026-05-25 |
| 🎙️ Distil-Whisper Large V3 | FP16 | 197 tok/s | 200 tok/s
-1%
| 1.9 GB | Xybrid CLI | community | 2026-04-19 |
TinyLlama 1.1B | FP16 | 192 tok/s | 200 tok/s
-4%
| 2.7 GB | Ollama | community | 2026-03-14 |
Qwen 3.5 0.8B | FP16 | 192 tok/s | 200 tok/s
-4%
| 2.1 GB | Ollama | community | 2026-03-14 |
SmolLM2 135M | FP16 | 190 tok/s | 200 tok/s
-5%
| 0.3 GB | LM Studio | community | 2026-05-24 |
| 🗣️ KittenTTS Nano | FP16 | 190 tok/s | 200 tok/s
-5%
| 0.1 GB | Xybrid CLI | community | 2026-03-27 |
Bonsai 8B (1-bit) | Q1 | 187 tok/s | 200 tok/s
-6%
| 1.4 GB | LM Studio | community | 2026-05-23 |
Whisper Small | FP16 | 184 tok/s | 200 tok/s
-8%
| 0.6 GB | MacWhisper | editorial | 2026-02-12 |
Qwen 2.5 Coder 0.5B | FP16 | 183 tok/s | 200 tok/s
-8%
| 1.4 GB | Ollama | community | 2026-03-17 |
| 🗣️ NeuTTS Air | FP16 | 183 tok/s | 200 tok/s
-8%
| 1.7 GB | Piper | editorial | 2026-03-17 |
LFM2.5 1.2B | FP16 | 177 tok/s | 200 tok/s
-11%
| 2.7 GB | LM Studio | editorial | 2026-02-08 |
| 🗣️ Dia 1.6B | FP16 | 175 tok/s | 165 tok/s
+6%
| 4.3 GB | Xybrid CLI | community | 2026-01-03 |
Qwen 2.5 Coder 1.5B | FP16 | 168 tok/s | 171 tok/s
-2%
| 3.4 GB | Ollama | community | 2026-01-03 |
| 🧠 DeepSeek R1 Distill 1.5B | FP16 | 166 tok/s | 165 tok/s
+1%
| 3.7 GB | Ollama | community | 2026-01-02 |
| 👁️ Moondream 2B | FP16 | 158 tok/s | 148 tok/s
+7%
| 4.0 GB | LM Studio | community | 2026-02-26 |
Whisper Large V3 | FP16 | 156 tok/s | 176 tok/s
-11%
| 3.8 GB | Xybrid CLI | community | 2026-02-20 |
StableLM 2 1.6B | FP16 | 155 tok/s | 165 tok/s
-6%
| 3.8 GB | Ollama | community | 2026-03-17 |
SmolLM2 1.7B | FP16 | 151 tok/s | 161 tok/s
-6%
| 4.3 GB | LM Studio | editorial | 2026-01-28 |
Qwen 3.5 2B | FP16 | 131 tok/s | 130 tok/s
+1%
| 4.7 GB | Xybrid CLI | editorial | 2026-04-03 |
Mistral 7B | Q4 | 127 tok/s | 37 tok/s
+243%
| 4.3 GB | LM Studio | editorial | 2026-03-20 |
Phi-4 Mini | Q8 | 119 tok/s | 70 tok/s
+70%
| 4.6 GB | Ollama | editorial | 2026-03-20 |
| 🎨 Stable Diffusion 3.5 Medium | FP16 | 116 tok/s | 119 tok/s
-3%
| 5.7 GB | Xybrid CLI | editorial | 2026-02-24 |
Gemma 4 E2B | FP16 | 114 tok/s | 121 tok/s
-6%
| 5.7 GB | Ollama | editorial | 2026-05-26 |
Qwen 2.5 3B | FP16 | 90 tok/s | 85 tok/s
+6%
| 7.6 GB | Ollama | community | 2026-01-18 |
Llama 3.2 3B | FP16 | 84 tok/s | 83 tok/s
+1%
| 7.5 GB | Xybrid CLI | editorial | 2026-04-03 |
Qwen 2.5 Coder 3B | FP16 | 84 tok/s | 85 tok/s
-1%
| 6.8 GB | Xybrid CLI | community | 2026-04-03 |
| 👨💻 StarCoder2 3B | FP16 | 78 tok/s | 88 tok/s
-11%
| 7.8 GB | LM Studio | editorial | 2026-05-25 |
Phi-4 Mini | FP16 | 77 tok/s | 70 tok/s
+10%
| 9.6 GB | Xybrid CLI | community | 2026-03-14 |
| 🎨 SDXL Turbo | FP16 | 76 tok/s | 84 tok/s
-10%
| 8.2 GB | Jan | community | 2026-01-18 |
Qwen 3.5 4B | FP16 | 66 tok/s | 67 tok/s
-1%
| 9.1 GB | Xybrid CLI | editorial | 2026-05-10 |
Gemma 3n E2B | FP16 | 63 tok/s | 61 tok/s
+3%
| 11.3 GB | Jan | community | 2026-04-22 |
Gemma 4 E4B | FP16 | 59 tok/s | 61 tok/s
-3%
| 9.7 GB | LM Studio | community | 2026-01-03 |
Gemma 3 4B | FP16 | 58 tok/s | 61 tok/s
-5%
| 10.5 GB | Xybrid CLI | community | 2026-01-19 |
Gemma 3n E4B | FP16 | 39 tok/s | 40 tok/s
-2%
| 16.3 GB | Ollama | community | 2026-04-23 |
Qwen 2.5 Coder 7B | FP16 | 39 tok/s | 35 tok/s
+11%
| 17.6 GB | LM Studio | editorial | 2026-02-12 |
| 👁️ LLaVA 1.6 7B | FP16 | 38 tok/s | 38 tok/s
+0%
| 15.6 GB | Xybrid CLI | community | 2026-04-03 |
Llama 3.1 8B | FP16 | 37 tok/s | 34 tok/s
+9%
| 19.5 GB | Ollama | community | 2026-05-12 |
| 👨💻 DeepSeek Coder 6.7B | FP16 | 37 tok/s | 40 tok/s
-7%
| 17.3 GB | Xybrid CLI | community | 2026-03-25 |
LFM2.5 8B A1B | FP16 | 36 tok/s | 33 tok/s
+9%
| 18.4 GB | Xybrid CLI | editorial | 2026-01-04 |
| 🧠 DeepSeek R1 Distill 7B | FP16 | 36 tok/s | 35 tok/s
+3%
| 17.2 GB | LM Studio | editorial | 2026-05-11 |
Qwen 2.5 7B | FP16 | 35 tok/s | 35 tok/s
+0%
| 18.3 GB | Jan | community | 2026-04-11 |
Mistral 7B | FP16 | 34 tok/s | 37 tok/s
-8%
| 18.9 GB | Jan | community | 2026-02-20 |
| 🧠 DeepSeek R1 Distill 8B | FP16 | 34 tok/s | 34 tok/s
+0%
| 20.6 GB | LM Studio | editorial | 2026-03-01 |
Qwen 3.5 9B | FP16 | 31 tok/s | 30 tok/s
+3%
| 21.2 GB | Jan | community | 2026-03-13 |
Qwen 2.5 VL 7B | FP16 | 31 tok/s | 34 tok/s
-9%
| 19.5 GB | LM Studio | community | 2026-03-20 |
| 🧠 Qwen3 8B | FP16 | 29 tok/s | 33 tok/s
-12%
| 19.2 GB | Jan | community | 2026-04-08 |
Gemma 3 12B | FP16 | 24 tok/s | 22 tok/s
+9%
| 27.6 GB | Xybrid CLI | editorial | 2026-01-04 |
Mistral Nemo 12B | FP16 | 24 tok/s | 22 tok/s
+9%
| 29.4 GB | Ollama | community | 2026-02-20 |
| 🎨 FLUX.1 Schnell | FP16 | 23 tok/s | 23 tok/s
+0%
| 27.2 GB | LM Studio | editorial | 2026-01-13 |
Phi-4 Medium | FP16 | 22 tok/s | 20 tok/s
+10%
| 29.7 GB | Ollama | community | 2026-04-06 |
Gemma 4 26B A4B | Q8 | 21 tok/s | 20 tok/s
+5%
| 32.2 GB | Ollama | editorial | 2026-02-19 |
Gemma 4 31B | Q8 | 17 tok/s | 17 tok/s
+0%
| 36.9 GB | LM Studio | editorial | 2026-04-05 |
Qwen 3.5 35B A3B | Q8 | 17 tok/s | 15 tok/s
+13%
| 40.2 GB | Ollama | community | 2026-03-03 |
| 👨💻 Laguna XS.2 | Q8 | 17 tok/s | 16 tok/s
+6%
| 37.1 GB | Xybrid CLI | community | 2026-05-28 |
Llama 4 Scout | Q2 | 12 tok/s | 13 tok/s
-8%
| 50.9 GB | Ollama | community | 2026-04-21 |
Qwen3 Coder Next | Q4 | 12 tok/s | 12 tok/s
+0%
| 58.0 GB | Jan | community | 2026-05-28 |