Which runs better on your device? Side-by-side comparison of specs, quantization sizes, and device compatibility.
| Quant | Gemma 3 4B | Phi-4 Mini | |
|---|---|---|---|
| FP16 | 8.9 GB | 7.8 GB | Phi-4 Mini smaller |
| Q8 | 4.9 GB | 4.4 GB | Phi-4 Mini smaller |
| Q6 | 3.5 GB | 3.1 GB | Phi-4 Mini smaller |
| Q5 | 3.1 GB | 2.7 GB | Phi-4 Mini smaller |
| Q4 | 2.5 GB | 2.2 GB | Phi-4 Mini smaller |
| Q3 | 1.9 GB | 1.7 GB | Phi-4 Mini smaller |
| Q2 | 1.5 GB | 1.2 GB | Phi-4 Mini smaller |
| Device | Gemma 3 4B | Phi-4 Mini |
|---|---|---|
| 💻 MacBook Air M4 macOS | Runs well FP16 · ~13 tok/s | Runs well FP16 · ~15 tok/s |
| 💻 MacBook Air M3 macOS | Runs well FP16 · ~11 tok/s | Runs well FP16 · ~13 tok/s |
| 💻 MacBook Air M2 macOS | Tight fit Q8 · ~20 tok/s | Runs well Q8 · ~23 tok/s |
| 💻 MacBook Pro M4 Pro macOS | Runs great FP16 · ~31 tok/s | Runs great FP16 · ~35 tok/s |
| 💻 MacBook Air M1 macOS | Tight fit Q8 · ~14 tok/s | Runs well Q8 · ~16 tok/s |
| 💻 MacBook Air M1 macOS | Runs well FP16 · ~8 tok/s | Runs well FP16 · ~9 tok/s |
| 💻 MacBook Pro M1 macOS | Runs well FP16 · ~8 tok/s | Runs well FP16 · ~9 tok/s |
| 💻 MacBook Pro M1 Pro macOS | Runs well FP16 · ~22 tok/s | Runs well FP16 · ~26 tok/s |
| 💻 MacBook Pro M1 Pro macOS | Runs great FP16 · ~22 tok/s | Runs great FP16 · ~26 tok/s |
| 💻 MacBook Pro M1 Max macOS | Runs great FP16 · ~45 tok/s | Runs great FP16 · ~51 tok/s |
| 💻 MacBook Pro M1 Max macOS | Runs great FP16 · ~45 tok/s | Runs great FP16 · ~51 tok/s |
| 💻 MacBook Pro M2 Pro macOS | Runs well FP16 · ~22 tok/s | Runs well FP16 · ~26 tok/s |
| 💻 MacBook Pro M2 Pro macOS | Runs great FP16 · ~22 tok/s | Runs great FP16 · ~26 tok/s |
| 💻 MacBook Pro M2 Max macOS | Runs great FP16 · ~45 tok/s | Runs great FP16 · ~51 tok/s |
| 💻 MacBook Pro M2 Max macOS | Runs great FP16 · ~45 tok/s | Runs great FP16 · ~51 tok/s |
| 💻 MacBook Pro M3 Pro macOS | Runs well FP16 · ~17 tok/s | Runs well FP16 · ~19 tok/s |
| 💻 MacBook Pro M3 Pro macOS | Runs great FP16 · ~17 tok/s | Runs great FP16 · ~19 tok/s |
| 💻 MacBook Pro M3 Max macOS | Runs great FP16 · ~45 tok/s | Runs great FP16 · ~51 tok/s |
| 💻 MacBook Pro M3 Max macOS | Runs great FP16 · ~45 tok/s | Runs great FP16 · ~51 tok/s |
| 📱 iPhone 16 Pro iOS | Tight fit Q6 · ~14 tok/s | Tight fit Q6 · ~15 tok/s |
| 📱 iPhone 15 iOS | Tight fit Q4 · ~12 tok/s | Tight fit Q5 · ~11 tok/s |
| 📱 Galaxy S25 Ultra Android | Tight fit Q8 · ~11 tok/s | Tight fit Q8 · ~12 tok/s |
| 📱 Galaxy S24 Android | Tight fit Q5 · ~14 tok/s | Tight fit Q6 · ~14 tok/s |
| 📱 Pixel 9 Pro Android | Runs well Q8 · ~10 tok/s | Runs well Q8 · ~11 tok/s |
| 🎮 Steam Deck OLED Linux | Runs well FP16 · ~10 tok/s | Runs well FP16 · ~11 tok/s |
| 🖥️ Gaming PC (RTX 4070) Windows | Tight fit FP16 · ~57 tok/s | Runs well FP16 · ~65 tok/s |
| 🖥️ Gaming PC (RTX 3060) Windows | Tight fit FP16 · ~40 tok/s | Runs well FP16 · ~46 tok/s |
| 🖥️ Gaming PC (RTX 4080) Windows | Runs well FP16 · ~81 tok/s | Runs great FP16 · ~92 tok/s |
| 🖥️ Gaming PC (RTX 4090) Windows | Runs great FP16 · ~113 tok/s | Runs great FP16 · ~129 tok/s |
| 🤖 Atom 1 Linux | Runs great FP16 · ~23 tok/s | Runs great FP16 · ~26 tok/s |
| 🤖 Atom 1 Linux | Runs great FP16 · ~31 tok/s | Runs great FP16 · ~35 tok/s |
| 🤖 Atom 1 Linux | Runs great FP16 · ~31 tok/s | Runs great FP16 · ~35 tok/s |
| 📱 iPad Pro M4 iOS | Runs well Q8 · ~17 tok/s | Runs well Q8 · ~19 tok/s |
| 🖥️ Mac Mini M1 macOS | Tight fit Q8 · ~14 tok/s | Runs well Q8 · ~16 tok/s |
| 🖥️ Mac Mini M1 macOS | Runs well FP16 · ~8 tok/s | Runs well FP16 · ~9 tok/s |
| 🖥️ Mac Mini M2 macOS | Tight fit Q8 · ~20 tok/s | Runs well Q8 · ~23 tok/s |
| 🖥️ Mac Mini M2 Pro macOS | Runs well FP16 · ~22 tok/s | Runs well FP16 · ~26 tok/s |
| 🖥️ Mac Mini M2 Pro macOS | Runs great FP16 · ~22 tok/s | Runs great FP16 · ~26 tok/s |
| 🖥️ Mac Mini M4 macOS | Runs well FP16 · ~13 tok/s | Runs well FP16 · ~15 tok/s |
| 🖥️ Mac Mini M4 macOS | Runs great FP16 · ~13 tok/s | Runs great FP16 · ~15 tok/s |
| 🖥️ Mac Mini M4 Pro macOS | Runs great FP16 · ~31 tok/s | Runs great FP16 · ~35 tok/s |
| 🖥️ Mac Mini M4 Pro macOS | Runs great FP16 · ~31 tok/s | Runs great FP16 · ~35 tok/s |
| 🖥️ Mac Studio M4 Max macOS | Runs great FP16 · ~61 tok/s | Runs great FP16 · ~70 tok/s |
| 🖥️ Mac Pro M2 Ultra macOS | Runs great FP16 · ~90 tok/s | Runs great FP16 · ~103 tok/s |
| 💻 Snapdragon X Elite Laptop Windows | Tight fit FP16 · ~15 tok/s | Runs well FP16 · ~17 tok/s |
| 📱 OnePlus 13 Android | Runs well Q8 · ~11 tok/s | Runs well Q8 · ~12 tok/s |
| 🍓 Raspberry Pi 5 Linux | Tight fit Q8 · ~7 tok/s | Runs well Q8 · ~7 tok/s |
Both models run on 47 of 47 devices. Gemma 3 4B is the larger model and may produce better quality outputs, while Phi-4 Mini is lighter on resources. For memory-constrained devices, Phi-4 Mini is smaller at its lowest quant (1.2 GB vs 1.5 GB).