Self-hostable software: Local LLMs (24)

Ollama is a tool for running open models locally and exposing them through a REST API for apps, agents, and integrations.

Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.

GPT4All runs large language models privately on everyday desktops and laptops, and provides a Python client around llama.cpp implementations.

An all-in-one AI application for chatting with documents, building AI agents, and running local or cloud LLM workflows.

AnythingLLM is an all-in-one AI application for chatting with documents, building AI agents, and running a configurable private ChatGPT-like workspace.

PrivateGPT is an open-source API layer that turns local models into production AI applications.

LocalAI is an open-source AI engine for running many kinds of models locally or on your own infrastructure, with API compatibility for common AI providers.

A desktop app for running local LLMs with chat, vision, tool-calling, training, image generation, and an API.

Jan is an open-source desktop app for downloading and running local LLMs with privacy-focused, local control, while also offering optional connections to cloud model providers.

Chatbox is a desktop AI copilot and chat client for ChatGPT, Claude, and other LLM providers on Windows, macOS, and Linux.

Khoj is a personal AI app for chat, search, and automation that can run locally or as a cloud service.

Vane is a privacy-focused AI answering engine that runs on your own hardware and returns cited answers from web search and local or cloud LLMs.