Install Ollama
Get Ollama running on macOS, Linux, or Windows, pull your first model, and confirm it works with ollama list. The shortest path to a local LLM.
Blog
Setup Toolbox
Posts on AI engineering, LLM systems, and software development.
Install llama.cpp
Build llama.cpp from source with Metal or CUDA, then run a GGUF model with llama-cli. The closest thing to bare-metal local inference.
Install LM Studio
Install LM Studio on macOS, Linux, and Windows, then flip on the local OpenAI-compatible server so any client library can talk to a model on your own machine.
Install the Anthropic SDK
Install the official Claude SDK for Python and Node, set your API key the safe way, and prove it works with a one-line call.
Install the OpenAI SDK
Install the OpenAI SDK for Python and Node, set your API key, and prove it works with a one-line chat call.