Type
Chat
Chat
Parameters
0.135B
0.5B
Context
8K
32K
Min tier
Low
Low
Runs on
67 / 67 devices
67 / 67 devices
Quant SmolLM2 135M Qwen 2.5 0.5B
FP16 0.3 GB 1.2 GB SmolLM2 135M smaller
Q8 0.1 GB 0.7 GB SmolLM2 135M smaller
Q6 0.6 GB
Q5 0.5 GB
Q4 0.1 GB 0.4 GB SmolLM2 135M smaller
Q3 0.3 GB
Q2 0.3 GB
Device SmolLM2 135M Qwen 2.5 0.5B
💻
MacBook Air M4 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~100 tok/s
💻
MacBook Air M3 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~83 tok/s
💻
MacBook Air M2 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~83 tok/s
💻
MacBook Pro M4 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
💻
MacBook Air M1 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~57 tok/s
💻
MacBook Air M1 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~57 tok/s
💻
MacBook Pro M1 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~57 tok/s
💻
MacBook Pro M1 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~167 tok/s
💻
MacBook Pro M1 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~167 tok/s
💻
MacBook Pro M1 Max macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
💻
MacBook Pro M1 Max macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
💻
MacBook Pro M2 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~167 tok/s
💻
MacBook Pro M2 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~167 tok/s
💻
MacBook Pro M2 Max macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
💻
MacBook Pro M2 Max macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
💻
MacBook Pro M3 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~125 tok/s
💻
MacBook Pro M3 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~125 tok/s
💻
MacBook Pro M3 Max macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
💻
MacBook Pro M3 Max macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
📱
iPhone 16 Pro iOS
Runs great FP16 · ~176 tok/s Runs great FP16 · ~40 tok/s
📱
iPhone 15 iOS
Runs great FP16 · ~109 tok/s Runs great FP16 · ~25 tok/s
📱
Galaxy S25 Ultra Android
Runs great FP16 · ~200 tok/s Runs great FP16 · ~45 tok/s
📱
Galaxy S24 Android
Runs great FP16 · ~158 tok/s Runs great FP16 · ~36 tok/s
📱
Pixel 9 Pro Android
Runs great FP16 · ~176 tok/s Runs great FP16 · ~40 tok/s
🎮
Steam Deck OLED Linux
Runs great FP16 · ~200 tok/s Runs great FP16 · ~73 tok/s
🖥️
Gaming PC (RTX 4070) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RTX 3060) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RTX 4080) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RTX 4090) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🤖
Atom 1 Linux
Runs great FP16 · ~200 tok/s Runs great FP16 · ~171 tok/s
🤖
Atom 1 Linux
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🤖
Atom 1 Linux
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
📱
iPad Pro M4 iOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~70 tok/s
🖥️
Mac Mini M1 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~57 tok/s
🖥️
Mac Mini M1 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~57 tok/s
🖥️
Mac Mini M2 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~83 tok/s
🖥️
Mac Mini M2 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~167 tok/s
🖥️
Mac Mini M2 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~167 tok/s
🖥️
Mac Mini M4 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~100 tok/s
🖥️
Mac Mini M4 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~100 tok/s
🖥️
Mac Mini M4 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Mac Mini M4 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Mac Studio M4 Max macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Mac Pro M2 Ultra macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
💻
Snapdragon X Elite Laptop Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~113 tok/s
📱
OnePlus 13 Android
Runs great FP16 · ~200 tok/s Runs great FP16 · ~45 tok/s
🍓
Raspberry Pi 5 Linux
Runs great FP16 · ~119 tok/s Runs great FP16 · ~27 tok/s
💻
MacBook Air M2 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~83 tok/s
💻
MacBook Air M3 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~83 tok/s
🖥️
Mac Studio M1 Ultra macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Mac Studio M2 Ultra macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Mac Studio M3 Ultra macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
💻
MacBook Pro M4 Max macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
💻
MacBook Pro M5 macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~128 tok/s
💻
MacBook Pro M5 Pro macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
💻
MacBook Pro M5 Max macOS
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RTX 4060) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RTX 3070) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RTX 3080) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RTX 3090) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RTX 5070) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RTX 5080) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RTX 5090) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RX 7800 XT) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (RX 7900 XTX) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (Arc B580) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s
🖥️
Gaming PC (Arc A770) Windows
Runs great FP16 · ~200 tok/s Runs great FP16 · ~200 tok/s

Both models run on 67 of 67 devices. Qwen 2.5 0.5B has a larger context window (32K vs 8K). Qwen 2.5 0.5B is the larger model and may produce better quality outputs, while SmolLM2 135M is lighter on resources. For memory-constrained devices, SmolLM2 135M is smaller at its lowest quant (0.1 GB vs 0.3 GB).