Type
Reasoning
Chat
Parameters
17B
7.62B
Context
128K
128K
Min tier
Ultra
High
Runs on
14 / 67 devices
67 / 67 devices
Quant Llama 4 Scout Qwen 2.5 7B
FP16 218.0 GB 15.5 GB Qwen 2.5 7B smaller
Q8 115.0 GB 8.1 GB Qwen 2.5 7B smaller
Q6 84.0 GB 5.9 GB Qwen 2.5 7B smaller
Q5 75.0 GB 5.1 GB Qwen 2.5 7B smaller
Q4 63.0 GB 4.4 GB Qwen 2.5 7B smaller
Q3 52.0 GB 3.3 GB Qwen 2.5 7B smaller
Q2 42.0 GB 2.5 GB Qwen 2.5 7B smaller
Device Llama 4 Scout Qwen 2.5 7B
💻
MacBook Air M4 macOS
Too heavy Runs well Q8 · ~15 tok/s
💻
MacBook Air M3 macOS
Too heavy Runs well Q8 · ~12 tok/s
💻
MacBook Air M2 macOS
Too heavy Tight fit Q5 · ~20 tok/s
💻
MacBook Pro M4 Pro macOS
Too heavy Runs great FP16 · ~18 tok/s
💻
MacBook Air M1 macOS
Too heavy Tight fit Q5 · ~13 tok/s
💻
MacBook Air M1 macOS
Too heavy Runs well Q8 · ~8 tok/s
💻
MacBook Pro M1 macOS
Too heavy Runs well Q8 · ~8 tok/s
💻
MacBook Pro M1 Pro macOS
Too heavy Runs well Q8 · ~25 tok/s
💻
MacBook Pro M1 Pro macOS
Too heavy Runs well FP16 · ~13 tok/s
💻
MacBook Pro M1 Max macOS
Too heavy Runs well FP16 · ~26 tok/s
💻
MacBook Pro M1 Max macOS
Tight fit Q2 · ~10 tok/s Runs great FP16 · ~26 tok/s
💻
MacBook Pro M2 Pro macOS
Too heavy Runs well Q8 · ~25 tok/s
💻
MacBook Pro M2 Pro macOS
Too heavy Runs well FP16 · ~13 tok/s
💻
MacBook Pro M2 Max macOS
Too heavy Runs well FP16 · ~26 tok/s
💻
MacBook Pro M2 Max macOS
Tight fit Q2 · ~10 tok/s Runs great FP16 · ~26 tok/s
💻
MacBook Pro M3 Pro macOS
Too heavy Runs well Q8 · ~19 tok/s
💻
MacBook Pro M3 Pro macOS
Too heavy Runs great FP16 · ~10 tok/s
💻
MacBook Pro M3 Max macOS
Too heavy Runs great FP16 · ~26 tok/s
💻
MacBook Pro M3 Max macOS
Tight fit Q4 · ~6 tok/s Runs great FP16 · ~26 tok/s
📱
iPhone 16 Pro iOS
Too heavy Tight fit Q3 · ~14 tok/s
📱
iPhone 15 iOS
Too heavy Tight fit Q2 · ~12 tok/s
📱
Galaxy S25 Ultra Android
Too heavy Tight fit Q4 · ~12 tok/s
📱
Galaxy S24 Android
Too heavy Tight fit Q3 · ~13 tok/s
📱
Pixel 9 Pro Android
Too heavy Tight fit Q6 · ~8 tok/s
🎮
Steam Deck OLED Linux
Too heavy Runs well Q8 · ~11 tok/s
🖥️
Gaming PC (RTX 4070) Windows
Too heavy Runs well Q8 · ~62 tok/s
🖥️
Gaming PC (RTX 3060) Windows
Too heavy Runs well Q8 · ~44 tok/s
🖥️
Gaming PC (RTX 4080) Windows
Too heavy Runs great Q8 · ~89 tok/s
🖥️
Gaming PC (RTX 4090) Windows
Tight fit Q2 · ~1 tok/s Runs well FP16 · ~65 tok/s
🤖
Atom 1 Linux
Too heavy Runs well FP16 · ~13 tok/s
🤖
Atom 1 Linux
Tight fit Q2 · ~7 tok/s Runs great FP16 · ~18 tok/s
🤖
Atom 1 Linux
Tight fit Q6 · ~3 tok/s Runs great FP16 · ~18 tok/s
📱
iPad Pro M4 iOS
Too heavy Tight fit Q6 · ~14 tok/s
🖥️
Mac Mini M1 macOS
Too heavy Tight fit Q5 · ~13 tok/s
🖥️
Mac Mini M1 macOS
Too heavy Runs well Q8 · ~8 tok/s
🖥️
Mac Mini M2 macOS
Too heavy Tight fit Q5 · ~20 tok/s
🖥️
Mac Mini M2 Pro macOS
Too heavy Runs well Q8 · ~25 tok/s
🖥️
Mac Mini M2 Pro macOS
Too heavy Runs well FP16 · ~13 tok/s
🖥️
Mac Mini M4 macOS
Too heavy Runs well Q8 · ~15 tok/s
🖥️
Mac Mini M4 macOS
Too heavy Runs well FP16 · ~8 tok/s
🖥️
Mac Mini M4 Pro macOS
Too heavy Tight fit FP16 · ~18 tok/s
🖥️
Mac Mini M4 Pro macOS
Too heavy Runs great FP16 · ~18 tok/s
🖥️
Mac Studio M4 Max macOS
Tight fit Q2 · ~13 tok/s Runs great FP16 · ~35 tok/s
🖥️
Mac Pro M2 Ultra macOS
Tight fit Q8 · ~7 tok/s Runs great FP16 · ~52 tok/s
💻
Snapdragon X Elite Laptop Windows
Too heavy Runs well Q8 · ~17 tok/s
📱
OnePlus 13 Android
Too heavy Tight fit Q6 · ~9 tok/s
🍓
Raspberry Pi 5 Linux
Too heavy Tight fit Q6 · ~5 tok/s
💻
MacBook Air M2 macOS
Too heavy Runs well Q8 · ~12 tok/s
💻
MacBook Air M3 macOS
Too heavy Tight fit Q5 · ~20 tok/s
🖥️
Mac Studio M1 Ultra macOS
Tight fit Q2 · ~19 tok/s Runs great FP16 · ~52 tok/s
🖥️
Mac Studio M2 Ultra macOS
Tight fit Q2 · ~19 tok/s Runs great FP16 · ~52 tok/s
🖥️
Mac Studio M3 Ultra macOS
Tight fit Q4 · ~13 tok/s Runs great FP16 · ~53 tok/s
💻
MacBook Pro M4 Max macOS
Too heavy Runs great FP16 · ~35 tok/s
💻
MacBook Pro M5 macOS
Too heavy Runs well Q8 · ~19 tok/s
💻
MacBook Pro M5 Pro macOS
Too heavy Tight fit FP16 · ~19 tok/s
💻
MacBook Pro M5 Max macOS
Too heavy Runs great FP16 · ~39 tok/s
🖥️
Gaming PC (RTX 4060) Windows
Too heavy Tight fit Q6 · ~46 tok/s
🖥️
Gaming PC (RTX 3070) Windows
Too heavy Tight fit Q6 · ~76 tok/s
🖥️
Gaming PC (RTX 3080) Windows
Too heavy Tight fit Q8 · ~94 tok/s
🖥️
Gaming PC (RTX 3090) Windows
Tight fit Q2 · ~1 tok/s Runs well FP16 · ~60 tok/s
🖥️
Gaming PC (RTX 5070) Windows
Too heavy Runs well Q8 · ~83 tok/s
🖥️
Gaming PC (RTX 5080) Windows
Too heavy Runs great Q8 · ~119 tok/s
🖥️
Gaming PC (RTX 5090) Windows
Tight fit Q2 · ~43 tok/s Runs great FP16 · ~116 tok/s
🖥️
Gaming PC (RX 7800 XT) Windows
Too heavy Runs great Q8 · ~77 tok/s
🖥️
Gaming PC (RX 7900 XTX) Windows
Tight fit Q2 · ~1 tok/s Runs well FP16 · ~62 tok/s
🖥️
Gaming PC (Arc B580) Windows
Too heavy Runs well Q8 · ~56 tok/s
🖥️
Gaming PC (Arc A770) Windows
Too heavy Runs great Q8 · ~69 tok/s

Qwen 2.5 7B fits more devices (67 vs 14). Llama 4 Scout is the larger model and may produce better quality outputs, while Qwen 2.5 7B is lighter on resources. For memory-constrained devices, Qwen 2.5 7B is smaller at its lowest quant (2.5 GB vs 42.0 GB).