Self-Hosted AI: Open-Source LLMs, Agents and Tools (226)

From local model inference to coding harnesses and autonomous agents, this is every self-hostable AI and LLM tool tracked on SelfHostedWorld -- organized by what each one actually does, since the category names overlap more than you'd expect.

AI Harness

13 projects

Agentic CLIs that drive your editor or terminal directly, running multi-step coding tasks on your behalf.

View all AI Harness tools →

AI Coding Assistant

49 projects

In-IDE autocomplete and chat that assists you as you write code, rather than acting on its own like a harness.

View all AI Coding Assistant tools →

Claws & Clankers

7 projects

Autonomous, often cloud-hosted agents that operate independently, well beyond a single coding session.

View all Claws & Clankers tools →

AI Agents

115 projects

General-purpose agent frameworks and orchestration tooling for building your own autonomous workflows.

View all AI Agents tools →

Inference Serving

7 projects

Backends that host and serve LLM inference over an API -- the plumbing other AI tools talk to.

View all Inference Serving tools →

Local LLMs

30 projects

Run large language models entirely on your own hardware, no cloud API required.

View all Local LLMs tools →

AI Interfaces

33 projects

Chat UIs and front-ends for talking to LLMs, whether local or cloud-hosted.

View all AI Interfaces tools →

AI RAG Systems

26 projects

Retrieval-augmented generation tooling that grounds LLM answers in your own documents and data.

View all AI RAG Systems tools →

Model Context Protocol

56 projects

Model Context Protocol servers and tooling that give LLMs structured access to external tools and data.

View all Model Context Protocol tools →

AI Media Generation

18 projects

Tools that generate images, video, or audio using AI models.

View all AI Media Generation tools →

All AI & LLM tools

Lobe Chat

84.1k

LobeHub is a self-hostable AI agent platform for organizing, creating, and collaborating with multi-agent workflows.

Artificial IntelligenceAI InterfacesSelf Hosting Solutions+3

6 Containers

LobeHub

84.1k

LobeHub is a self-hostable platform for organizing, creating, and collaborating with AI agents as a team.

Artificial IntelligenceGenerative AISelf Hosting Solutions+4

10 Containers

Huginn

50.3k

Huginn is a self-hosted automation system for building agents that monitor online sources and perform actions on the user's behalf.

Automation ToolsPermissive LicenseAI Agents+3

4 Containers

AnythingLLM

68.0k

An all-in-one AI application for chatting with documents, building AI agents, and running local or cloud LLM workflows.

Artificial IntelligenceAutomation ToolsSelf Hosting Solutions+7

Single Container

Ollama

186.0k

Ollama is a tool for running open models locally and exposing them through a REST API for apps, agents, and integrations.

Artificial IntelligenceLocal LLMsGenerative AI+3

Langflow

156.4k

Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.

Low Code DevelopmentAutomation ToolsModel Context Protocol+2

10 Containers

SillyTavern

35.3k

SillyTavern is a locally installed interface for interacting with text generation LLMs, image generation engines, and TTS voice models.

Artificial IntelligenceAI InterfacesCopyleft License+3

Single Container

vLLM

96.4k

A fast, easy-to-use library for LLM inference and serving.

Inference ServingLocal LLMsAI Tooling

2 Containers

Langfuse

37.1k

Langfuse is an open source LLM engineering platform for teams to develop, monitor, evaluate, and debug AI applications.

IDE ToolsArtificial IntelligencePermissive License+5

6 ContainersFOSS with Issues

Postiz

41.0k

Postiz is a social media management platform for scheduling, automating, and analyzing content.

Analytics ToolsAutomation ToolsSocial Media+3

9 Containers

LocalAI

50.2k

LocalAI is an open-source AI engine for running LLMs and other model types locally on a wide range of hardware, with drop-in API compatibility for several popular AI APIs.

Generative AIPermissive LicenseArtificial Intelligence+4

Single Container

Zed

92.9k

Zed is a high-performance multiplayer code editor.

Artificial IntelligenceAI Coding AssistantIDE Tools+2

2 Containers

Codex

133.4k

Codex CLI is a local coding agent from OpenAI that runs on your computer.

Artificial IntelligenceAI Coding AssistantPermissive License+3

Paperless-ngx

47.8k

Paperless-ngx is a document management system that turns physical documents into a searchable online archive.

Document ManagementDigital ArchivingAutomation Tools+3

Karakeep

30.3k

Karakeep is a self-hostable bookmark-everything app with AI-assisted tagging and search for saving links, notes, images, PDFs, and highlights.

Bookmark ManagementPastebinsCopyleft License+4

3 Containers

Discourse

48.0k

An open-source community platform for running discussion forums and real-time chat.

Social NetworksCopyleft LicenseSelf Hosting Solutions+1

private-gpt

57.6k

PrivateGPT is an open-source API layer that turns local models into production AI applications.

Artificial IntelligenceAI RAG SystemsPermissive License+2

OpenClaw

394.0k

OpenClaw is a personal AI assistant that runs on the user's own devices and connects to messaging channels, voice, and a live canvas interface.

Claws & ClankersSelf Hosting SolutionsAI Agents+2

2 Containers

LibreChat

46.8k

LibreChat is a self-hosted AI chat platform that unifies major AI providers in a ChatGPT-like interface.

Artificial IntelligenceAI InterfacesPermissive License+4

5 Containers

LibreChat

46.8k

LibreChat is a self-hosted AI chat platform that unifies major AI providers in a ChatGPT-like interface.

Artificial IntelligenceAI InterfacesLocal LLMs+2

6 Containers

Context7

64.3k

Context7 provides up-to-date, version-specific library documentation and code examples for LLM prompts via a CLI skill flow or MCP server.

Model Context ProtocolArtificial IntelligencePermissive License+2

opencode

224.8k

An open source AI coding agent.

Artificial IntelligenceAI Coding AssistantPermissive License+3

orca

116.8k

Orca is an AI orchestrator for running multiple coding agents side-by-side in isolated worktrees, with a desktop app, mobile companion, and CLI automation.

AI AgentsAI Coding AssistantAI Tooling+1

goose

56.3k

goose is a native open source AI agent with desktop, CLI, and API interfaces for code, workflows, and other tasks.

Artificial IntelligenceAI Coding AssistantAI Agents+3

Single Container

Frigate

37.3k

Frigate NVR is a local network video recorder for IP cameras with realtime AI object detection and Home Assistant integration.

Video SurveillancePermissive LicenseAutomation Tools+2

presidio

11.7k

Presidio is a PII detection and anonymization SDK for text and images. It helps organizations identify and de-identify sensitive data in automated or semi-automated workflows.

AI ToolingFully FOSSAutomation Tools

4 ContainersFully FOSS

Libre Translate

17.3k

A free and open source machine translation API that is entirely self-hosted.

Miscellaneous ToolsSoftware LocalizationArtificial Intelligence+3

Single Container

onlook

27.1k

Onlook is an open-source, visual-first code editor for building and editing Next.js + TailwindCSS apps with AI.

Website BuildersArtificial IntelligenceAI Coding Assistant+2

Single Container

Vibe Kanban

28.6k

Vibe Kanban is a kanban-based workspace for planning work, running coding agents, reviewing diffs, and shipping changes.

Dev Project ManagementAI Coding AssistantAI Agents+2

6 ContainersTelemetry: Opt-Out

hyperframes

79.6k

HyperFrames is an open-source framework for turning HTML, CSS, media, and seekable animations into deterministic MP4 videos.

Video EditingAutomation ToolsAI Media Generation

Cline

71.4k

An open source coding agent for use in the IDE and terminal.

Artificial IntelligenceAI Coding AssistantPermissive License+3

oh-my-pi

38.0k

A coding agent with the IDE wired in.

AI Coding AssistantAI AgentsModel Context Protocol+1

2 Containers

Jan

45.5k

Jan is an open-source desktop app for downloading and running local LLMs with privacy-focused, local control, while also offering optional connections to cloud model providers.

Artificial IntelligenceAI InterfacesPermissive License+1

Continue

36.4k

Continue is an open-source coding agent available as a CLI, VS Code extension, and JetBrains plugin.

Artificial IntelligenceAI Coding AssistantAI Agents+2

hermes-agent

260.9k

Hermes Agent is a self-improving AI agent with a built-in learning loop, terminal UI, and messaging gateway for chatting and automating work across platforms.

Artificial IntelligenceAI AgentsAI Coding Assistant+2

2 Containers

Pi

120.3k

Pi Agent Harness is a mono-repo for a self-extensible coding agent, including an interactive coding agent CLI, agent runtime, and a unified multi-provider LLM API.

AI HarnessAI AgentsAI Coding Assistant+1

llamafile

26.6k

llamafile lets users distribute and run LLMs as a single-file executable with no installation. It also includes whisperfile for local speech-to-text transcription and translation.

Artificial IntelligenceLocal LLMsAI Tooling+2

MeiliSearch

59.8k

A lightning-fast search engine that fits into apps, websites, and workflows, with built-in features for relevant search experiences.

Search EnginesPermissive LicenseDatabase Management+1

bolt.diy

20.0k

An open source AI coding assistant that lets users build full-stack Node.js apps in the browser or desktop app while choosing from many LLM providers.

Artificial IntelligenceAI Coding AssistantPermissive License+1

3 Containers

text-generation-webui

47.7k

A desktop app for running local LLMs with chat, vision, tool-calling, training, image generation, and an API.

Artificial IntelligenceSelf Hosting SolutionsAI Interfaces+2

Single Container

Letta

25.4k

Letta is a framework for building stateful agents with memory that can learn and improve over time.

AI AgentsAI ToolingGenerative AI

Opik

23.2k

Opik is an open-source platform for observability, evaluation, monitoring, and optimization of LLM applications and agentic systems.

API ManagementArtificial IntelligenceAI Tooling+6

LibrePhotos

8.1k

LibrePhotos is a self-hosted photo management service with face recognition, object detection, and semantic search.

Photo GalleriesMedia ManagementArtificial Intelligence+2

KoboldCpp

12.2k

KoboldCpp is a self-contained AI text-generation runner for GGML and GGUF models, with bundled UI, multiple inference modes, and broad support for image, audio, video, and vision tasks.

Inference ServingLocal LLMsAI Interfaces+2

Single Container

buzz

36.8k

Buzz is a self-hostable workspace where humans and AI agents collaborate in shared rooms backed by a signed event log.

Self Hosting SolutionsCustom CommunicationsKnowledge Management+2

7 Containers

Typesense

27.1k

Typesense is a fast, typo-tolerant search engine for building search experiences.

Search EnginesDatabase ManagementAI RAG Systems+2

odysseus

95.2k

Odysseus is a self-hosted AI workspace for chat, agents, research, documents, email, notes, calendar, and local model workflows.

Artificial IntelligenceAI AgentsAI Interfaces+3

4 Containers

AutoGPT

187.9k

AutoGPT is a platform for creating, deploying, and managing continuous AI agents that automate complex workflows.

Artificial IntelligenceAutomation ToolsPermissive License+2

13 ContainersOpen Core