Self-hostable software: Local LLMs (22)

Ollama is a local runtime for running open models and interacting with them through a CLI, REST API, and integrations.

Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.

GPT4All runs large language models privately on everyday desktops and laptops, and provides a Python client around llama.cpp implementations.

AnythingLLM is a local-first AI app for chatting with documents and building AI agents with multi-user support.

AnythingLLM is an all-in-one AI application for chatting with documents, running AI agents, and managing multi-user workspaces locally or in the cloud.

PrivateGPT is a production-ready AI project for asking questions about documents with large language models while keeping data private and local.

A Gradio web UI for running large language models locally, with chat, vision, tool-calling, training, and image generation.

LocalAI is an open-source AI engine for running and serving many kinds of models locally, with API compatibility for common AI providers.

An open-source ChatGPT replacement for downloading and running local LLMs with privacy and control.

Chatbox is a desktop AI copilot and chat client for ChatGPT, Claude, and other LLM providers on Windows, macOS, and Linux.

Vane is a privacy-focused AI answering engine that runs on your own hardware and returns cited answers from web search and local or cloud LLMs.

Vane is a privacy-focused AI answering engine that runs on your own hardware and combines web search with local or cloud LLMs to deliver cited answers.