text-generation-webui
★ 47.7kA self-hosted alternative to Chatgpt
GNU Affero General Public License v3.0Open Source — No PaywallSingle Container — single container — minimal hosting footprintDocker · Compose · Binary +1No external DB10+ active committers (12mo)
About
TextGen is a desktop application for running local large language models on a user’s own machine. It is aimed at people who want a private, offline interface for chatting with models, experimenting...
Community Ratings
No ratings yetNew this week
Read recap →Weekly Recap — Oct 2, 2026 – Oct 9, 2026Oct 9, 2026
Features
- chat and generation modes
- vision/multimodal input
- file attachments
- conversation branching and message editing
- notebook tab
- multiple model backends
- OpenAI/Anthropic-compatible API
- tool-calling and MCP server support
- LoRA training
- image generation
Details
- Last Updated
- Oct 11, 2026
- Created
- Dec 21, 2022
- Install Methods
- dockerdocker-composebinarysource
- Requirements
- Python 3.9+PyTorchConda/Miniforge (for full installation)~10GB disk spaceGGUF models
- Minimum Requirements
- Disk: ~10GB
- API
- REST
- Privacy & Independence
- No TelemetryNo Cloud RequiredOffline Capable
- Deployment
Deployment: Docker Compose ✓Single Container — minimal hosting footprintsingle container
Run text-generation-webui with Docker Compose
Compose file from the text-generation-webui project repository.
1 service
no resource limits declared
needs persistent storage (1 volume)
docker/amd/docker-compose.yml · @ ed888c7 · scanned Jun 4, 2026
version: "3.3"
services:
textgen:
build:
context: .
args:
BUILD_EXTENSIONS: ${BUILD_EXTENSIONS:-}
APP_GID: ${APP_GID:-6972}
APP_UID: ${APP_UID:-6972}
env_file: .env
user: "${APP_RUNTIME_UID:-6972}:${APP_RUNTIME_GID:-6972}"
ports:
- "${HOST_PORT:-7860}:${CONTAINER_PORT:-7860}"
- "${HOST_API_PORT:-5000}:${CONTAINER_API_PORT:-5000}"
stdin_open: true
group_add:
- video
tty: true
ipc: host
devices:
- /dev/kfd
- /dev/dri
cap_add:
- SYS_PTRACE
security_opt:
- seccomp=unconfined
volumes:
- ./user_data:/home/app/textgen/user_data
This file may be out of date. Check the text-generation-webui documentation for current setup steps.
Tags
Track your self-hosted stack
Bookmark software to try, rate tools you've used, and keep your collection in one place.
Metadata extracted from README on Jun 4, 2026
Related Software
SillyTavern
34.3k
SillyTavern is a locally installed interface for interacting with text generation LLMs, image generation engines, and TTS voice models.
Artificial IntelligenceAI InterfacesCopyleft License+3
Single Container
KoboldCpp
12.0k
KoboldCpp is a self-contained AI text-generation runner for GGML and GGUF models, with bundled UI, multiple inference modes, and broad support for image, audio, video, and vision tasks.
Inference ServingLocal LLMsAI Interfaces+2
Single Container
LocalAI
49.5k
LocalAI is an open-source AI engine that runs LLMs and other multimodal models locally on a wide range of hardware, with OpenAI-compatible APIs and on-demand backends.
Generative AIPermissive LicenseArtificial Intelligence+4
Single Container
LibreChat
45.5k
LibreChat is a self-hosted AI chat platform that unifies major AI providers in a ChatGPT-like interface.
Artificial IntelligenceAI InterfacesPermissive License+4
5 Containers
Open Notebook
40.0k
Open Notebook is a private, self-hosted, multi-model alternative to Google NotebookLM for organizing content, chatting with it, and generating podcasts.
Note Taking AppsKnowledge ManagementArtificial Intelligence+5
big-AGI
7.1k
Big-AGI is a multi-model AI workspace for experts, focused on chat, model comparison, and local-first self-hosting.
Artificial IntelligenceAI InterfacesAI Media Generation+2
Open Core
AnythingLLM
66.9k
An all-in-one AI application for chatting with documents, building AI agents, and running local or cloud LLM workflows.
Artificial IntelligenceAutomation ToolsSelf Hosting Solutions+7
Single Container
Open-WebUI
154.2k
Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.
Artificial IntelligenceAI InterfacesLocal LLMs+7
2 ContainersOpen CoreFOSS with Issues
Perplexica
37.2k
Vane is a privacy-focused AI answering engine that runs on your own hardware and returns cited answers from web search and local or cloud LLMs.
Artificial IntelligencePermissive LicenseSearch Engines+5
Vane
37.2k
Vane is a privacy-focused AI answering engine that runs on your own hardware and combines web search with local or cloud LLMs to deliver cited answers.
Artificial IntelligencePermissive LicenseGenerative AI+6
LLM Harbor
3.2k
Harbor is a CLI and companion app for spinning up and managing a local LLM stack with pre-wired services like Open WebUI, llama.cpp, Ollama, vLLM, SearXNG, Speaches, and ComfyUI.
Artificial IntelligenceLocal LLMsAI Tooling+5
BionicGPT
2.4k
Bionic is an on-premise, ChatGPT-like generative AI platform for running locally or at data-center scale with strict data confidentiality.
Artificial IntelligenceAI InterfacesAI RAG Systems+3
Open Core