Run LLMs locally with Harbor

Harbor is a containerized LLM toolkit. Default harbor up starts Open WebUI (webui) and llama.cpp (llamacpp). This skill is the operational playbook for installing Harbor, choosing a backend, pulling models, wiring search/voice/code tools, and pointing coding agents at the same stack.

For the full CLI catalog, harbor skills get harbor. For Boost module authoring, use the boost-modules skill.

Agent rules

• harbor logs follows forever and will hang a non-interactive shell. Read logs with docker logs harbor.<service> (add --tail 200 if needed).
• Never edit .env by hand. Use harbor config get/set and harbor env.
• Do not set llamacpp.model / llamacpp.model.specifier unless the user explicitly wants a single pinned GGUF. Router mode (empty specifier) discovers pulled GGUFs automatically.
• harbor launch options (--backend, --model, --web, --workflow, --config, --service) go before the tool name. Everything after the tool name is the tool's own argv.
• After harbor update, run harbor config update if new keys are missing from the local config.

Read only what you need