Gemma 4 31B 18 GB
Google's dense flagship open model — near server-grade quality, 256K context
MIN TIER
Ultra
SMALLEST QUANT
Q2 · 10.5 GB
CONTEXT WINDOW
128K tokens
PARAMETERS
31B
QUANTIZATION OPTIONS
| Quant | File size | Quality | |
|---|---|---|---|
| FP16 | 64.0 GB | 100% | Best quality |
| Q8 | 33.0 GB | 95% | |
| Q6 | 24.0 GB | 85% | |
| Q5 | 21.0 GB | 78% | |
| Q4 | 18.0 GB | 70% | |
| Q3 | 13.5 GB | 58% | |
| Q2 | 10.5 GB | 42% |
DEVICE COMPATIBILITY
Runs on these devices (54)
🖥️
Gaming PC (RTX 5090) 64GB
Windows Q6 · ~75 tok/s · 24.0 GB
Tight fit 🖥️ Mac Pro M2 Ultra 192GB
macOS FP16 · ~13 tok/s · 64.0 GB
Runs great 🖥️ Gaming PC (RTX 4090) 64GB
Windows Q5 · ~48 tok/s · 21.0 GB
Tight fit 🖥️ Mac Studio M1 Ultra 64GB
macOS Q8 · ~24 tok/s · 33.0 GB
Runs well 🖥️ Mac Studio M2 Ultra 64GB
macOS Q8 · ~24 tok/s · 33.0 GB
Runs well 🖥️ Gaming PC (RTX 3090) 64GB
Windows Q5 · ~45 tok/s · 21.0 GB
Tight fit 🖥️ Gaming PC (RX 7900 XTX) 64GB
Windows Q5 · ~46 tok/s · 21.0 GB
Tight fit 🖥️ Gaming PC (RTX 4080) 32GB
Windows Q3 · ~53 tok/s · 13.5 GB
Tight fit 🖥️ Gaming PC (RTX 5080) 32GB
Windows Q3 · ~71 tok/s · 13.5 GB
Tight fit 🖥️ Mac Studio M4 Max 64GB
macOS Q8 · ~17 tok/s · 33.0 GB
Runs well 🖥️ Gaming PC (RTX 3080) 32GB
Windows Q4 · ~42 tok/s · 18.0 GB
Tight fit 🖥️ Gaming PC (RX 7800 XT) 32GB
Windows Q3 · ~46 tok/s · 13.5 GB
Tight fit 🖥️ Gaming PC (RTX 5070) 32GB
Windows Q2 · ~64 tok/s · 10.5 GB
Tight fit 💻 MacBook Pro M1 Max 64GB
macOS Q8 · ~12 tok/s · 33.0 GB
Runs well 💻 MacBook Pro M2 Max 64GB
macOS Q8 · ~12 tok/s · 33.0 GB
Runs well 🖥️ Gaming PC (RTX 4070) 32GB
Windows Q2 · ~48 tok/s · 10.5 GB
Tight fit 🖥️ Gaming PC (Arc A770) 32GB
Windows Q3 · ~41 tok/s · 13.5 GB
Tight fit 🤖 Atom 1 64GB
Linux Q8 · ~8 tok/s · 33.0 GB
Runs well 💻 MacBook Pro M5 Pro 24GB
macOS Q3 · ~22 tok/s · 13.5 GB
Tight fit 🤖 Atom 1 128GB
Linux FP16 · ~4 tok/s · 64.0 GB
Runs well 🖥️ Mac Mini M4 Pro 24GB
macOS Q3 · ~20 tok/s · 13.5 GB
Tight fit 🖥️ Gaming PC (Arc B580) 32GB
Windows Q2 · ~43 tok/s · 10.5 GB
Tight fit 🖥️ Gaming PC (RTX 3070) 32GB
Windows Q3 · ~33 tok/s · 13.5 GB
Tight fit 💻 MacBook Pro M4 Max 48GB
macOS Q8 · ~17 tok/s · 33.0 GB
Tight fit 💻 MacBook Pro M5 Max 48GB
macOS Q8 · ~18 tok/s · 33.0 GB
Tight fit 🖥️ Gaming PC (RTX 3060) 32GB
Windows Q2 · ~34 tok/s · 10.5 GB
Tight fit 🖥️ Mac Studio M3 Ultra 96GB
macOS FP16 · ~13 tok/s · 64.0 GB
Tight fit 💻 MacBook Pro M1 Max 32GB
macOS Q5 · ~19 tok/s · 21.0 GB
Tight fit 💻 MacBook Pro M2 Max 32GB
macOS Q5 · ~19 tok/s · 21.0 GB
Tight fit 💻 MacBook Pro M3 Max 36GB
macOS Q6 · ~17 tok/s · 24.0 GB
Tight fit 💻 MacBook Pro M4 Pro 36GB
macOS Q6 · ~11 tok/s · 24.0 GB
Tight fit 💻 MacBook Pro M3 Max 96GB
macOS FP16 · ~6 tok/s · 64.0 GB
Tight fit 🖥️ Mac Mini M4 Pro 48GB
macOS Q8 · ~8 tok/s · 33.0 GB
Tight fit 🖥️ Gaming PC (RTX 4060) 32GB
Windows Q3 · ~20 tok/s · 13.5 GB
Tight fit 🤖 Atom 1 32GB
Linux Q6 · ~9 tok/s · 24.0 GB
Tight fit 💻 MacBook Pro M1 Pro 32GB
macOS Q5 · ~10 tok/s · 21.0 GB
Tight fit 💻 MacBook Pro M2 Pro 32GB
macOS Q5 · ~10 tok/s · 21.0 GB
Tight fit 💻 MacBook Pro M3 Pro 36GB
macOS Q6 · ~6 tok/s · 24.0 GB
Tight fit 🖥️ Mac Mini M2 Pro 32GB
macOS Q5 · ~10 tok/s · 21.0 GB
Tight fit 💻 MacBook Pro M1 Pro 16GB
macOS Q2 · ~19 tok/s · 10.5 GB
Tight fit 💻 MacBook Pro M2 Pro 16GB
macOS Q2 · ~19 tok/s · 10.5 GB
Tight fit 🖥️ Mac Mini M2 Pro 16GB
macOS Q2 · ~19 tok/s · 10.5 GB
Tight fit 🖥️ Mac Mini M4 32GB
macOS Q5 · ~6 tok/s · 21.0 GB
Tight fit 💻 MacBook Pro M3 Pro 18GB
macOS Q2 · ~14 tok/s · 10.5 GB
Tight fit 💻 MacBook Pro M5 16GB
macOS Q2 · ~15 tok/s · 10.5 GB
Tight fit 💻 Snapdragon X Elite Laptop 16GB
Windows Q2 · ~13 tok/s · 10.5 GB
Tight fit 💻 MacBook Air M4 16GB
macOS Q2 · ~11 tok/s · 10.5 GB
Tight fit 💻 MacBook Air M3 16GB
macOS Q2 · ~10 tok/s · 10.5 GB
Tight fit 🖥️ Mac Mini M4 16GB
macOS Q2 · ~11 tok/s · 10.5 GB
Tight fit 💻 MacBook Air M2 16GB
macOS Q2 · ~10 tok/s · 10.5 GB
Tight fit 🎮 Steam Deck OLED 16GB
Linux Q2 · ~8 tok/s · 10.5 GB
Tight fit 💻 MacBook Air M1 16GB
macOS Q2 · ~7 tok/s · 10.5 GB
Tight fit 💻 MacBook Pro M1 16GB
macOS Q2 · ~7 tok/s · 10.5 GB
Tight fit 🖥️ Mac Mini M1 16GB
macOS Q2 · ~7 tok/s · 10.5 GB
Tight fit Too heavy for these devices (13)
💻
MacBook Air M2 8GB
macOS needs 10.5 GB
Too heavy 💻 MacBook Air M1 8GB
macOS needs 10.5 GB
Too heavy 📱 iPhone 16 Pro 8GB
iOS needs 10.5 GB
Too heavy 📱 iPhone 15 6GB
iOS needs 10.5 GB
Too heavy 📱 Galaxy S25 Ultra 12GB
Android needs 10.5 GB
Too heavy 📱 Galaxy S24 8GB
Android needs 10.5 GB
Too heavy 📱 Pixel 9 Pro 16GB
Android needs 10.5 GB
Too heavy 📱 iPad Pro M4 16GB
iOS needs 10.5 GB
Too heavy 🖥️ Mac Mini M1 8GB
macOS needs 10.5 GB
Too heavy 🖥️ Mac Mini M2 8GB
macOS needs 10.5 GB
Too heavy 📱 OnePlus 13 16GB
Android needs 10.5 GB
Too heavy 🍓 Raspberry Pi 5 8GB
Linux needs 10.5 GB
Too heavy 💻 MacBook Air M3 8GB
macOS needs 10.5 GB
Too heavy RUN WITH THESE APPS
HOW TO RUN
Step-by-step run guides coming soon — check the apps above to get started today.