LLM Harbor
★ 3.2kAbout
Harbor is a local AI stack manager aimed at people who want to run and connect LLM-related services without manually wiring containers and configuration together. It provides a CLI plus a companion...
Community Ratings
No ratings yetNew this week
Read recap →Weekly Recap — Oct 2, 2026 – Oct 9, 2026Oct 9, 2026
Features
- local LLM stack orchestration
- Open WebUI integration
- support for multiple LLM backends
- web search via SearXNG
- voice chat with STT/TTS
- image generation with ComfyUI
- MCP tool integration
- QR code and URL access
- built-in tunneling
- config profiles
Details
- Last Updated
- Oct 10, 2026
- Created
- Jul 27, 2024
- Install Methods
- sourcedocker-compose
- Requirements
- Docker Compose
- Runtime / Stack
- DockerShell
- Privacy & Independence
- No Cloud RequiredOffline Capable
- Deployment
Deployment: Docker Compose ✓
Compose parse error
missing services key
# Harbor works by combining multiple
# compose files together and is orchestrated by the CLI.
# See Readme.md for more information.
# If you want to obtain your own configuration, see `harbor eject`.
networks:
harbor-network:
external: false
Tags
Track your self-hosted stack
Bookmark software to try, rate tools you've used, and keep your collection in one place.
Metadata extracted from README on Aug 5, 2026
Related Software
AnythingLLM
66.9k
An all-in-one AI application for chatting with documents, building AI agents, and running local or cloud LLM workflows.
Artificial IntelligenceAutomation ToolsSelf Hosting Solutions+7
Single Container
Open-WebUI
154.2k
Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.
Artificial IntelligenceAI InterfacesLocal LLMs+7
2 ContainersOpen CoreFOSS with Issues
ollaya
1.3k
Ollaya runs open decision models locally and provides Ollama-like CLI, daemon, and API access for model serving.
Artificial IntelligenceLocal LLMsInference Serving+2
KoboldCpp
12.0k
KoboldCpp is a self-contained AI text-generation runner for GGML and GGUF models, with bundled UI, multiple inference modes, and broad support for image, audio, video, and vision tasks.
Inference ServingLocal LLMsAI Interfaces+2
Single Container
SillyTavern
34.3k
SillyTavern is a locally installed interface for interacting with text generation LLMs, image generation engines, and TTS voice models.
Artificial IntelligenceAI InterfacesCopyleft License+3
Single Container
text-generation-webui
47.7k
A desktop app for running local LLMs with chat, vision, tool-calling, training, image generation, and an API.
Artificial IntelligenceSelf Hosting SolutionsAI Interfaces+2
Single Container
Perplexica
37.2k
Vane is a privacy-focused AI answering engine that runs on your own hardware and returns cited answers from web search and local or cloud LLMs.
Artificial IntelligencePermissive LicenseSearch Engines+5
Vane
37.2k
Vane is a privacy-focused AI answering engine that runs on your own hardware and combines web search with local or cloud LLMs to deliver cited answers.
Artificial IntelligencePermissive LicenseGenerative AI+6
BionicGPT
2.4k
Bionic is an on-premise, ChatGPT-like generative AI platform for running locally or at data-center scale with strict data confidentiality.
Artificial IntelligenceAI InterfacesAI RAG Systems+3
Open Core
Lobe Chat
83.1k
LobeHub is a self-hostable AI agent platform for organizing, creating, and collaborating with multi-agent workflows.
Artificial IntelligenceAI InterfacesSelf Hosting Solutions+3
6 Containers
LobeHub
83.1k
LobeHub is a self-hostable platform for organizing, building, and collaborating with AI agents as teammates.
Artificial IntelligenceGenerative AISelf Hosting Solutions+4
10 ContainersCloud Required
LibreChat
45.5k
LibreChat is a self-hosted AI chat platform that unifies major AI providers in a ChatGPT-like interface.
Artificial IntelligenceAI InterfacesPermissive License+4
5 Containers