Self-hostable software: Local LLMs (28)

Ollama is a tool for running open models locally and exposing them through a REST API for apps, agents, and integrations.

Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.

A fast, easy-to-use library for LLM inference and serving.

GPT4All runs large language models privately on everyday desktops and laptops, and provides a Python client around llama.cpp implementations.

An all-in-one AI application for chatting with documents, building AI agents, and running local or cloud LLM workflows.

PrivateGPT is an open-source API layer that turns local models into production AI applications.

LocalAI is an open-source AI engine for running LLMs, vision, voice, image, and video models locally on a wide range of hardware.

A desktop app for running local LLMs with chat, vision, tool-calling, training, image generation, and an API.

Jan is an open-source desktop app for downloading and running local LLMs with privacy-focused, local control, while also offering optional connections to cloud model providers.

LibreChat is a self-hosted AI chat platform that unifies major AI providers in a ChatGPT-like interface.

Chatbox is a desktop AI copilot and chat client for ChatGPT, Claude, and other LLM providers on Windows, macOS, and Linux.

Khoj is a personal AI app for chat, search, and automation that can run locally or as a cloud service.