mlx-optiq Local Models

Run models on your Mac

Guides you through running a quantized language model on your own Apple Silicon Mac with mlx-optiq. The workflow checks your Mac's memory, checks that mlx-optiq is installed (and points you to the install steps if it is not, without installing anything itself), helps you pick a model that fits, and, once you confirm the download, starts it with optiq serve as a local chat-completions endpoint. More