KoboldCpp
★ 11.8kA self-hosted alternative to Chatgpt
GNU Affero General Public License v3.0Open Source — No PaywallSingle Container — single container — minimal hosting footprintDocker · Binary · SourceNo external DB116+ active committers (12mo)
About
KoboldCpp is a self-contained local AI inference application built around llama.cpp for running GGML and GGUF models. It is aimed at users who want an easy way to launch text-generation and...
Community Ratings
No ratings yetNew this week
Read recap →Weekly Recap — Sep 11, 2026 – Sep 18, 2026Sep 18, 2026
Features
- single-file executable
- CPU or GPU inference
- LLM text generation
- image generation and editing
- video generation
- speech-to-text
- text-to-speech
- music generation
- image recognition
- MCP server support and tool calling
Details
- Last Updated
- Sep 21, 2026
- Created
- Mar 16, 2023
- Install Methods
- dockerbinarysource
- Requirements
- GGUF modelsNvidia GPU (for CUDA support)AMD GPUX11 (for the Linux GUI script)curlbzip2conda
- API
- REST
- Backup & Export
- native-exportfile-backup
- Privacy & Independence
- Cloud: OptionalOffline Capable
- Deployment
Deployment: Docker Compose ✓Single Container — minimal hosting footprintsingle container
Docker Compose
1 service
no resource limits declared
needs persistent storage (1 volume)
examples/docker-reference/docker-compose.yml · @ bf9b9bd · scanned Aug 7, 2026
version: "3.2"
services:
koboldcpp:
container_name: koboldcpp
image: koboldai/koboldcpp:latest
security_opt:
- apparmor:unconfined # AppArmor breaks sockets, don't worry everything is securely confined within docker
volumes:
- ./kcpp-data:/workspace/:rw
# devices: # Uncomment this section to add support for AMD/Intel GPU's
# - /dev/dri:/dev/dri
deploy: # You can remove this section if you do not wish to use an Nvidia GPU
resources:
reservations:
devices:
- driver: nvidia
device_ids: ['0']
capabilities: [gpu]
environment:
- KCPP_DONT_UPDATE=false
# ...
Tags
Track your self-hosted stack
Bookmark software to try, rate tools you've used, and keep your collection in one place.
Metadata extracted from README on Aug 7, 2026
Related Software
OpenClaw
390.2k
OpenClaw is a personal AI assistant that runs on the user's own devices and connects to messaging channels, voice, and a live canvas interface.
Claws & ClankersSelf Hosting SolutionsAI Agents+2
2 Containers
opencode
208.9k
An open source AI coding agent.
Artificial IntelligenceAI Coding AssistantPermissive License+3
n8n
205.5k
n8n is a fair-code platform for building and deploying AI agents and workflow automation with a visual canvas and custom code.
Automation ToolsPermissive LicenseLow Code Development+5
Single ContainerSource AvailableNot FOSS
AutoGPT
187.5k
AutoGPT is a platform for creating, deploying, and managing continuous AI agents that automate complex workflows.
Artificial IntelligenceAutomation ToolsPermissive License+2
13 ContainersOpen Core
Ollama
181.3k
Ollama is a tool for running open models locally and exposing them through a REST API for apps, agents, and integrations.
Artificial IntelligenceLocal LLMsGenerative Artificial Intelligence Genai+3
Langflow
155.1k
Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.
Low Code DevelopmentAutomation ToolsModel Context Protocol+2
11 Containers
Open-WebUI
152.7k
Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.
Artificial IntelligenceAI InterfacesLocal LLMs+7
2 ContainersOpen CoreFOSS with Issues
ComfyUI
134.1k
ComfyUI is a modular node-based AI engine for creating images, video, 3D, audio, and other content with fine-grained control over models and parameters.
Artificial IntelligenceAI Media GenerationCopyleft License+2
Freemium
Excalidraw
132.5k
An open source virtual hand-drawn style whiteboard for creating diagrams and wireframes.
Diagramming ToolsKnowledge ManagementPermissive License
Single Container
Stirling-PDF
92.7k
An open-source PDF editing platform for desktop, browser, and self-hosted server use.
Document ManagementPermissive LicenseSelf Hosting Solutions+2
Single ContainerOpen CoreFOSS with Issues
vLLM
92.3k
A fast, easy-to-use library for LLM inference and serving.
Inference ServingLocal LLMsAI Tooling
2 Containers
Zed
90.6k
Zed is a high-performance multiplayer code editor.
Artificial IntelligenceAI Coding AssistantIDE Tools+2
2 Containers