Self-hostable software: Local LLMs (22)

Ollama is a tool for running and managing open models locally and exposing them through a REST API.

Open WebUI is a self-hosted AI platform for chatting with LLMs, RAG, and related tools, designed to run entirely offline.

GPT4All runs large language models privately on everyday desktops and laptops, and provides a Python client around llama.cpp implementations.

AnythingLLM is a local-first, multi-user AI application for chatting with documents, building AI agents, and managing LLM-powered workflows.

AnythingLLM is a local-first AI app for chatting with documents and building AI agents with multi-user support.

PrivateGPT is a production-ready AI project for asking questions about documents with large language models while keeping data private and local.

A Gradio web UI for running large language models locally, with chat, vision, tool-calling, training, and image generation.

LocalAI is an open-source AI engine for running LLMs, vision, voice, image, and video models on local or self-hosted hardware with OpenAI-compatible APIs.

An open-source ChatGPT replacement for downloading and running local LLMs with privacy and control.

Chatbox is a desktop AI copilot and chat client for ChatGPT, Claude, and other LLM providers on Windows, macOS, and Linux.

Vane is a privacy-focused AI answering engine that runs on your own hardware and returns cited answers from web search and local or cloud LLMs.

Vane is a privacy-focused AI answering engine that runs on your own hardware and combines web search with local or cloud LLMs to deliver cited answers.