Model Quant Measured Estimated RAM used App Source Date
Mistral 7B Mistral 7B Q4 166 tok/s 87 tok/s +91% 4.3 GB LM Studio editorial 2026-03-20
Phi-4 Mini Phi-4 Mini Q8 155 tok/s 92 tok/s +68% 4.6 GB Ollama editorial 2026-03-20