█▀█ █▀▀ ▄▀█ █▀▄ █▀▄▀█ █▀█ █▀█ █▀▀
█▀▄ ██▄ █▀█ █▄▀ █ ▀ █ █▄█ █▀▄ ██▄
Your Mac is a powerhouse that you are likely wasting on simple spreadsheets and emails. In this video, we dive into Apple's official MLX LM framework to show you how to run high-speed local AI models directly on your machine. We move past the limitations of GGUF to explore the sheer speed of native Apple Silicon optimisation.
Key takeaways from the video
- Why MLX is the superior choice for Apple Silicon users compared to GGUF.
- How to install and configure MLX LM using Python and Conda.\n- Steps to serve a model locally and connect it to tools like Open Code.
- Using Pi Agent to turn your local model into a functional system assistant
- The foundational knowledge required to eventually link multiple Macs for massive VRAM gains.
Code examples: https://samuelgregory.co.uk/videos/apple-showed-us-how-to-run-local-ai-agents-the-right-way
----------
Check out the fix for MLX-LM running Gemma models
█▀▄ ██▄ █▀█ █▄▀ █ ▀ █ █▄█ █▀▄ ██▄
Your Mac is a powerhouse that you are likely wasting on simple spreadsheets and emails. In this video, we dive into Apple's official MLX LM framework to show you how to run high-speed local AI models directly on your machine. We move past the limitations of GGUF to explore the sheer speed of native Apple Silicon optimisation.
Key takeaways from the video
- Why MLX is the superior choice for Apple Silicon users compared to GGUF.
- How to install and configure MLX LM using Python and Conda.\n- Steps to serve a model locally and connect it to tools like Open Code.
- Using Pi Agent to turn your local model into a functional system assistant
- The foundational knowledge required to eventually link multiple Macs for massive VRAM gains.
Code examples: https://samuelgregory.co.uk/videos/apple-showed-us-how-to-run-local-ai-agents-the-right-way
----------
Check out the fix for MLX-LM running Gemma models
- Категория
- AI инструменты
Комментариев нет.
