Install Ollama
Install Ollama on macOS, Linux, and Windows. Pull your first model, run it locally, and verify with ollama list. The fastest path to a local LLM.
Blog
Setup Toolbox
Posts on AI engineering, LLM systems, and software development.
Install llama.cpp
Build llama.cpp from source with Metal or CUDA acceleration. Run a GGUF model with llama-cli. The closest thing to bare-metal local inference.
Install LM Studio
Install LM Studio on macOS, Linux, and Windows. The fastest GUI for running local LLMs — no terminal needed. Includes the local server for OpenAI-compatible API access.
Install the Anthropic SDK
Install the Anthropic SDK for Python and Node, configure your API key, and verify with a one-line messages.create call to Claude.
Install the OpenAI SDK
Install the OpenAI SDK for Python and Node, configure your API key, and verify with a one-line chat.completions call.