Qwen 2.5 0.5B 477 MB
Lightweight chat — surprisingly capable
MIN TIER
Low
SMALLEST QUANT
Q2 · 0.3 GB
CONTEXT WINDOW
32K tokens
PARAMETERS
0.5B
QUANTIZATION OPTIONS
| Quant | File size | Quality | |
|---|---|---|---|
| FP16 | 1.2 GB | 100% | Best quality |
| Q8 | 0.7 GB | 95% | |
| Q6 | 0.6 GB | 85% | |
| Q5 | 0.5 GB | 78% | |
| Q4 | 0.4 GB | 70% | |
| Q3 | 0.3 GB | 58% | |
| Q2 | 0.3 GB | 42% |
DEVICE COMPATIBILITY
Runs on these devices (47)
💻
MacBook Air M4 16GB
macOS FP16 · ~100 tok/s · 1.2 GB
Runs great 💻 MacBook Air M3 16GB
macOS FP16 · ~83 tok/s · 1.2 GB
Runs great 💻 MacBook Air M2 8GB
macOS FP16 · ~83 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M4 Pro 36GB
macOS FP16 · ~200 tok/s · 1.2 GB
Runs great 💻 MacBook Air M1 8GB
macOS FP16 · ~57 tok/s · 1.2 GB
Runs great 💻 MacBook Air M1 16GB
macOS FP16 · ~57 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M1 16GB
macOS FP16 · ~57 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M1 Pro 16GB
macOS FP16 · ~167 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M1 Pro 32GB
macOS FP16 · ~167 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M1 Max 32GB
macOS FP16 · ~200 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M1 Max 64GB
macOS FP16 · ~200 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M2 Pro 16GB
macOS FP16 · ~167 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M2 Pro 32GB
macOS FP16 · ~167 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M2 Max 32GB
macOS FP16 · ~200 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M2 Max 64GB
macOS FP16 · ~200 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M3 Pro 18GB
macOS FP16 · ~125 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M3 Pro 36GB
macOS FP16 · ~125 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M3 Max 36GB
macOS FP16 · ~200 tok/s · 1.2 GB
Runs great 💻 MacBook Pro M3 Max 96GB
macOS FP16 · ~200 tok/s · 1.2 GB
Runs great 🎮 Steam Deck OLED 16GB
Linux FP16 · ~73 tok/s · 1.2 GB
Runs great 🖥️ Gaming PC (RTX 4070) 32GB
Windows FP16 · ~200 tok/s · 1.2 GB
Runs great 🖥️ Gaming PC (RTX 3060) 32GB
Windows FP16 · ~200 tok/s · 1.2 GB
Runs great 🖥️ Gaming PC (RTX 4080) 32GB
Windows FP16 · ~200 tok/s · 1.2 GB
Runs great 🖥️ Gaming PC (RTX 4090) 64GB
Windows FP16 · ~200 tok/s · 1.2 GB
Runs great 🤖 Atom 1 32GB
Linux FP16 · ~171 tok/s · 1.2 GB
Runs great 🤖 Atom 1 64GB
Linux FP16 · ~200 tok/s · 1.2 GB
Runs great 🤖 Atom 1 128GB
Linux FP16 · ~200 tok/s · 1.2 GB
Runs great 📱 iPad Pro M4 16GB
iOS FP16 · ~70 tok/s · 1.2 GB
Runs great 🖥️ Mac Mini M1 8GB
macOS FP16 · ~57 tok/s · 1.2 GB
Runs great 🖥️ Mac Mini M1 16GB
macOS FP16 · ~57 tok/s · 1.2 GB
Runs great 🖥️ Mac Mini M2 8GB
macOS FP16 · ~83 tok/s · 1.2 GB
Runs great 🖥️ Mac Mini M2 Pro 16GB
macOS FP16 · ~167 tok/s · 1.2 GB
Runs great 🖥️ Mac Mini M2 Pro 32GB
macOS FP16 · ~167 tok/s · 1.2 GB
Runs great 🖥️ Mac Mini M4 16GB
macOS FP16 · ~100 tok/s · 1.2 GB
Runs great 🖥️ Mac Mini M4 32GB
macOS FP16 · ~100 tok/s · 1.2 GB
Runs great 🖥️ Mac Mini M4 Pro 24GB
macOS FP16 · ~200 tok/s · 1.2 GB
Runs great 🖥️ Mac Mini M4 Pro 48GB
macOS FP16 · ~200 tok/s · 1.2 GB
Runs great 🖥️ Mac Studio M4 Max 64GB
macOS FP16 · ~200 tok/s · 1.2 GB
Runs great 🖥️ Mac Pro M2 Ultra 192GB
macOS FP16 · ~200 tok/s · 1.2 GB
Runs great 💻 Snapdragon X Elite Laptop 16GB
Windows FP16 · ~113 tok/s · 1.2 GB
Runs great 📱 Galaxy S25 Ultra 12GB
Android FP16 · ~45 tok/s · 1.2 GB
Runs great 📱 OnePlus 13 16GB
Android FP16 · ~45 tok/s · 1.2 GB
Runs great 📱 iPhone 16 Pro 8GB
iOS FP16 · ~40 tok/s · 1.2 GB
Runs great 📱 Pixel 9 Pro 16GB
Android FP16 · ~40 tok/s · 1.2 GB
Runs great 📱 Galaxy S24 8GB
Android FP16 · ~36 tok/s · 1.2 GB
Runs great 🍓 Raspberry Pi 5 8GB
Linux FP16 · ~27 tok/s · 1.2 GB
Runs great 📱 iPhone 15 6GB
iOS FP16 · ~25 tok/s · 1.2 GB
Runs great COMPARE WITH ANOTHER MODEL
RUN WITH THESE APPS
HOW TO RUN
Step-by-step run guides coming soon — check the apps above to get started today.