Quantization Formats for Apple Silicon LLM Inference
How to pick the right quantization format for running large language models on Apple Silicon.
Mireille Okonkwo
Mireille Okonkwo
2 stories
Running Llama 3 Locally on Apple Silicon With Ollama
A complete walkthrough for running Llama 3 locally on your Mac with Ollama.
Mireille Okonkwo