GPT4All
★ 77.3kA self-hosted alternative to Chatgpt
About
GPT4All is a local large language model application and Python client designed for private use on everyday desktops and laptops. It targets users who want to run LLMs without relying on external API...
Community Ratings
No ratings yetNew this week
Read recap →Weekly Recap — Nov 6, 2026 – Nov 13, 2026Nov 13, 2026
Features
- private local LLM inference
- desktop chat application
- LocalDocs for chatting with data
- Python client
- OpenAI-compatible HTTP API server
- offline build support
- model gallery
- GPU inference with Vulkan
- LangChain integration
- Weaviate integration
Details
- Last Updated
- Nov 14, 2026
- Created
- Mar 27, 2023
- Install Methods
- dockerpackage-managerbinaryflatpaksource
- Requirements
- Intel Core i3 2nd Gen / AMD Bulldozer or better for Windows and Linux buildsQualcomm Snapdragon or Microsoft SQ1/SQ2 processors for Windows ARM buildmacOS Monterey 12.6 or newer for macOS buildx86-64 Linux (no ARM)
- Minimum Requirements
- CPU: Intel Core i3 2nd Gen / AMD Bulldozer or better
- API
- REST
- Privacy & Independence
- No Cloud RequiredOffline Capable
- Deployment
Deployment: no container deployment found
Run GPT4All yourself
Pick how much you want to manage.
netcupBest matchFull control
A small server, then Docker Compose.
About 20 minutes with Docker
HetznerFull control
A small server, then Docker Compose.
About 20 minutes with Docker
DigitalOceanFull control
A small server, then Docker Compose.
About 20 minutes with Docker
1 more way to host
Some links earn us a commission. netcup pays us one and is our preferred VPS host.
Is this your project? Sponsor a listing
Tags
Track your self-hosted stack
Bookmark software to try, rate tools you've used, and keep your collection in one place.
Metadata extracted from README on Mar 25, 2026
Alternatives to GPT4All
private-gpt
57.6k
PrivateGPT is an open-source API layer that turns local models into production AI applications.
Artificial IntelligenceAI RAG SystemsPermissive License+2
Open-WebUI
158.7k
Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.
Artificial IntelligenceAI InterfacesLocal LLMs+7
2 ContainersOpen CoreFOSS with Issues
text-generation-webui
47.7k
A desktop app for running local LLMs with chat, vision, tool-calling, training, image generation, and an API.
Artificial IntelligenceSelf Hosting SolutionsAI Interfaces+2
Single Container
AnythingLLM
68.3k
An all-in-one AI application for chatting with documents, building AI agents, and running local or cloud LLM workflows.
Artificial IntelligenceAutomation ToolsGenerative AI+7
Single Container
NextChatAI
89.0k
NextChat is a light, fast AI assistant web app and desktop client with support for multiple AI models and local browser storage.
Artificial IntelligenceAI InterfacesPermissive License+1
2 ContainersOpen Core
Chatbox
42.3k
Chatbox is a desktop AI copilot and chat client for ChatGPT, Claude, and other LLM providers on Windows, macOS, and Linux.
Artificial IntelligenceAI InterfacesLocal LLMs
LocalAI
50.4k
LocalAI is an open-source AI engine for running LLMs and other model types locally on a wide range of hardware, with drop-in API compatibility for several popular AI APIs.
Generative AIPermissive LicenseArtificial Intelligence+4
Single Container
Jan
45.7k
Jan is an open-source desktop app for downloading and running local LLMs with privacy-focused, local control, while also offering optional connections to cloud model providers.
Artificial IntelligenceAI InterfacesPermissive License+1
LibreChat
47.1k
LibreChat is a self-hosted AI chat platform that unifies major AI providers in a ChatGPT-like interface.
Artificial IntelligenceAI InterfacesLocal LLMs+2
6 Containers
LibreChat
47.1k
LibreChat is a self-hosted AI chat platform that unifies major AI providers in a ChatGPT-like interface.
Artificial IntelligenceAI InterfacesPermissive License+4
5 Containers
KoboldCpp
12.3k
KoboldCpp is a self-contained AI text-generation runner for GGML and GGUF models, with bundled UI, multiple inference modes, and broad support for image, audio, video, and vision tasks.
Inference ServingLocal LLMsAI Interfaces+2
Single Container
Related Software
Ollama
187.0k
Ollama is a tool for running open models locally and exposing them through a REST API for apps, agents, and integrations.
Artificial IntelligenceLocal LLMsGenerative AI+3
LLM
12.8k
A CLI tool and Python library for interacting with large language models from remote APIs or locally installed models.
Artificial IntelligenceLocal LLMsAI Tooling+1
Text Generation Inference
10.9k
A Rust, Python, and gRPC server for deploying and serving large language models with high-performance text generation.
Inference ServingArtificial IntelligenceLocal LLMs+1
2 Containers
LLM Harbor
3.3k
Harbor is a CLI and companion app for spinning up and managing a local LLM stack with pre-wired services like Open WebUI, Ollama, llama.cpp, SearXNG, Speaches, and ComfyUI.
Artificial IntelligenceLocal LLMsAI Tooling+5
llamafile
26.6k
llamafile lets users distribute and run LLMs as a single-file executable with no installation. It also includes whisperfile for local speech-to-text transcription and translation.
Artificial IntelligenceLocal LLMsAI Tooling+2
HuggingFace Chat UI
11.0k
A SvelteKit chat interface for OpenAI-compatible LLM APIs, powering HuggingChat.
Artificial IntelligenceAI InterfacesSelf Hosting Solutions+1
Khoj
38.1k
Khoj is a personal AI app for chat, search, and automation that can run locally or as a cloud service.
Artificial IntelligenceCopyleft LicenseGenerative AI+5
5 ContainersOpen Core
SillyTavern
35.6k
SillyTavern is a locally installed interface for interacting with text generation LLMs, image generation engines, and TTS voice models.
Artificial IntelligenceAI InterfacesCopyleft License+3
Single Container
Perplexica
38.2k
Vane is a privacy-focused AI answering engine that runs on your own hardware and returns cited answers from web search and local or cloud LLMs.
Artificial IntelligencePermissive LicenseSearch Engines+5
IronClaw
12.7k
A secure personal AI assistant that runs with local data storage, sandboxed tools, and multiple interaction channels.
Artificial IntelligenceClaws & ClankersAI Agents+3
ollaya
1.5k
Ollaya runs open decision models locally and provides Ollama-like CLI, daemon, and API access for model serving.
Artificial IntelligenceLocal LLMsInference Serving+2
vLLM
96.9k
vLLM is a fast, easy-to-use library and server for LLM inference and serving.
Inference ServingLocal LLMsAI Tooling
2 Containers