onmydevice
.ai
⌘
⌘
Devices
Models
Benchmarks
Apps
Replace
Blog
Gemma 3n E2B
3.0 GB
Chat
32K context
·
Requires Mid+ tier device
Google's on-device multimodal — 2B effective params with vision and audio
MIN TIER
Mid
SMALLEST QUANT
Q4 · 3.0 GB
CONTEXT WINDOW
32K tokens
PARAMETERS
2B
QUANTIZATION OPTIONS
Quant
File size
Quality
FP16
8.9 GB
100%
Best quality
Q8
4.8 GB
95%
Q6
4.2 GB
85%
Q5
3.3 GB
78%
Q4
3.0 GB
70%
DEVICE COMPATIBILITY
Runs on these devices (46)
🖥️
Gaming PC (RTX 4090)
64GB
Windows
FP16
·
~113 tok/s
·
8.9 GB
Runs great
🖥️
Mac Studio M4 Max
64GB
macOS
FP16
·
~61 tok/s
·
8.9 GB
Runs great
🖥️
Mac Pro M2 Ultra
192GB
macOS
FP16
·
~90 tok/s
·
8.9 GB
Runs great
💻
MacBook Pro M1 Max
32GB
macOS
FP16
·
~45 tok/s
·
8.9 GB
Runs great
💻
MacBook Pro M1 Max
64GB
macOS
FP16
·
~45 tok/s
·
8.9 GB
Runs great
💻
MacBook Pro M2 Max
32GB
macOS
FP16
·
~45 tok/s
·
8.9 GB
Runs great
💻
MacBook Pro M2 Max
64GB
macOS
FP16
·
~45 tok/s
·
8.9 GB
Runs great
💻
MacBook Pro M3 Max
36GB
macOS
FP16
·
~45 tok/s
·
8.9 GB
Runs great
💻
MacBook Pro M3 Max
96GB
macOS
FP16
·
~45 tok/s
·
8.9 GB
Runs great
🖥️
Gaming PC (RTX 4080)
32GB
Windows
FP16
·
~80 tok/s
·
8.9 GB
Runs well
💻
MacBook Pro M4 Pro
36GB
macOS
FP16
·
~31 tok/s
·
8.9 GB
Runs great
🤖
Atom 1
64GB
Linux
FP16
·
~31 tok/s
·
8.9 GB
Runs great
🤖
Atom 1
128GB
Linux
FP16
·
~31 tok/s
·
8.9 GB
Runs great
🖥️
Mac Mini M4 Pro
24GB
macOS
FP16
·
~31 tok/s
·
8.9 GB
Runs great
🖥️
Mac Mini M4 Pro
48GB
macOS
FP16
·
~31 tok/s
·
8.9 GB
Runs great
🤖
Atom 1
32GB
Linux
FP16
·
~23 tok/s
·
8.9 GB
Runs great
💻
MacBook Pro M1 Pro
32GB
macOS
FP16
·
~22 tok/s
·
8.9 GB
Runs great
💻
MacBook Pro M2 Pro
32GB
macOS
FP16
·
~22 tok/s
·
8.9 GB
Runs great
🖥️
Mac Mini M2 Pro
32GB
macOS
FP16
·
~22 tok/s
·
8.9 GB
Runs great
🖥️
Gaming PC (RTX 4070)
32GB
Windows
FP16
·
~57 tok/s
·
8.9 GB
Tight fit
💻
MacBook Pro M3 Pro
36GB
macOS
FP16
·
~17 tok/s
·
8.9 GB
Runs great
🖥️
Mac Mini M4
32GB
macOS
FP16
·
~13 tok/s
·
8.9 GB
Runs great
💻
MacBook Pro M1 Pro
16GB
macOS
FP16
·
~22 tok/s
·
8.9 GB
Runs well
💻
MacBook Pro M2 Pro
16GB
macOS
FP16
·
~22 tok/s
·
8.9 GB
Runs well
🖥️
Gaming PC (RTX 3060)
32GB
Windows
FP16
·
~40 tok/s
·
8.9 GB
Tight fit
🖥️
Mac Mini M2 Pro
16GB
macOS
FP16
·
~22 tok/s
·
8.9 GB
Runs well
💻
MacBook Pro M3 Pro
18GB
macOS
FP16
·
~17 tok/s
·
8.9 GB
Runs well
📱
iPad Pro M4
16GB
iOS
Q8
·
~18 tok/s
·
4.8 GB
Runs well
💻
MacBook Air M4
16GB
macOS
FP16
·
~13 tok/s
·
8.9 GB
Runs well
🖥️
Mac Mini M4
16GB
macOS
FP16
·
~13 tok/s
·
8.9 GB
Runs well
💻
MacBook Air M3
16GB
macOS
FP16
·
~11 tok/s
·
8.9 GB
Runs well
🎮
Steam Deck OLED
16GB
Linux
FP16
·
~10 tok/s
·
8.9 GB
Runs well
📱
OnePlus 13
16GB
Android
Q8
·
~11 tok/s
·
4.8 GB
Runs well
💻
MacBook Air M1
16GB
macOS
FP16
·
~8 tok/s
·
8.9 GB
Runs well
💻
MacBook Pro M1
16GB
macOS
FP16
·
~8 tok/s
·
8.9 GB
Runs well
📱
Pixel 9 Pro
16GB
Android
Q8
·
~10 tok/s
·
4.8 GB
Runs well
🖥️
Mac Mini M1
16GB
macOS
FP16
·
~8 tok/s
·
8.9 GB
Runs well
🍓
Raspberry Pi 5
8GB
Linux
Q8
·
~7 tok/s
·
4.8 GB
Runs well
💻
MacBook Air M2
8GB
macOS
Q8
·
~21 tok/s
·
4.8 GB
Tight fit
🖥️
Mac Mini M2
8GB
macOS
Q8
·
~21 tok/s
·
4.8 GB
Tight fit
💻
Snapdragon X Elite Laptop
16GB
Windows
FP16
·
~15 tok/s
·
8.9 GB
Tight fit
💻
MacBook Air M1
8GB
macOS
Q8
·
~14 tok/s
·
4.8 GB
Tight fit
🖥️
Mac Mini M1
8GB
macOS
Q8
·
~14 tok/s
·
4.8 GB
Tight fit
📱
Galaxy S25 Ultra
12GB
Android
Q8
·
~11 tok/s
·
4.8 GB
Tight fit
📱
iPhone 16 Pro
8GB
iOS
Q5
·
~14 tok/s
·
3.3 GB
Tight fit
📱
Galaxy S24
8GB
Android
Q5
·
~13 tok/s
·
3.3 GB
Tight fit
Too heavy for these devices (1)
📱
iPhone 15
6GB
iOS
needs 3.0 GB
Too heavy
RUN WITH THESE APPS
Beginner
Free
LM Studio
Beautiful desktop app for running local AI models
Tinkerer
Free
Ollama
Lightweight CLI tool for running models in the background
Beginner
Free
Jan
Open-source ChatGPT-like desktop app
HOW TO RUN
Step-by-step run guides coming soon — check the apps above to get started today.