Extremely slow generation on a Mac
Symptom
Tokens trickle out, the machine lags, Activity Monitor shows heavy swap or red memory pressure.
Likely causes
- Model + context exceeds the GPU-usable share of unified memory
- Other apps consume RAM
- Low Power Mode or thermal throttling
How to fix it
- Check memory pressure in Activity Monitor; close browsers and other heavy apps.
- Pick a smaller model/quant or shorter context; leave several GB free for macOS.
- Optionally raise the GPU wired limit (resets on reboot).
- Disable Low Power Mode and keep the machine plugged in.
bash
# example for a 64 GB Mac (value in MB), resets on reboot
sudo sysctl iogpu.wired_limit_mb=57344Still stuck? Check the lessons or measure first with the benchmark lab.