Self-Hosted AI RAG Systems: 26 Open-Source Apps
Best for your setup
Homelab Novice
Wants it running tonight, with one command.
AnythingLLM66.9k
An all-in-one AI application for chatting with documents, building AI agents, and running local or cloud LLM workflows.
- Single container
- Ships a Compose file
See all88/100 fitHow well this app matches homelab novices, 0 to 100
Homelab Expert
Runs a stack already and wants it to plug in.
honcho7.6k
Honcho is a memory infrastructure service for building stateful agents that store, reason over, and query changing relationships and session context over time.
- REST or GraphQL API
- Multi-user
See allDefault rank #6
79/100 fitHow well this app matches homelab experts, 0 to 100
Homelab Hacker
Wants control: APIs, scripts and many ways to run it.
Manticore Search12.0k
Manticore Search is an open-source fast database for search, positioned as an alternative to Elasticsearch.
- Scriptable API
- Many ways to install
See allDefault rank #7
87/100 fitHow well this app matches homelab hackers, 0 to 100
26 projects
AnythingLLM
66.9k
An all-in-one AI application for chatting with documents, building AI agents, and running local or cloud LLM workflows.
Artificial IntelligenceAutomation ToolsSelf Hosting Solutions+7
Single Container
private-gpt
57.6k
PrivateGPT is an open-source API layer that turns local models into production AI applications.
Artificial IntelligenceAI RAG SystemsPermissive License+2
Opik
22.5k
Opik is an open-source platform for observability, evaluation, monitoring, and optimization of LLM applications and agentic systems.
API ManagementArtificial IntelligenceAI Tooling+6
Typesense
26.8k
Typesense is a fast, typo-tolerant search engine for building search experiences.
Search EnginesDatabase ManagementAI RAG Systems+2
Open-WebUI
154.2k
Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.
Artificial IntelligenceAI InterfacesLocal LLMs+7
2 ContainersOpen CoreFOSS with Issues
honcho
7.6k
Honcho is a memory infrastructure service for building stateful agents that store, reason over, and query changing relationships and session context over time.
AI AgentsAI RAG SystemsAI Tooling+1
4 Containers
Manticore Search
12.0k
Manticore Search is an open-source fast database for search, positioned as an alternative to Elasticsearch.
Search EnginesCopyleft LicenseDatabase Management+2
Sim Studio
29.8k
An open-source platform for building AI agents and orchestrating agentic workflows with integrations, LLMs, and vector databases.
Automation ToolsArtificial IntelligenceAI Tooling+4
Blinko
11.1k
Blinko is an AI-powered card note-taking app for quickly capturing, organizing, and searching personal notes.
Note Taking AppsCopyleft LicenseKnowledge Management+4
Single Container
Perplexica
37.2k
Vane is a privacy-focused AI answering engine that runs on your own hardware and returns cited answers from web search and local or cloud LLMs.
Artificial IntelligencePermissive LicenseSearch Engines+5
Vane
37.2k
Vane is a privacy-focused AI answering engine that runs on your own hardware and combines web search with local or cloud LLMs to deliver cited answers.
Artificial IntelligencePermissive LicenseGenerative AI+6
Open Notebook
40.0k
Open Notebook is a private, self-hosted, multi-model alternative to Google NotebookLM for organizing content, chatting with it, and generating podcasts.
Note Taking AppsKnowledge ManagementArtificial Intelligence+5
Onyx Community Edition
32.4k
Onyx is a self-hostable open source AI chat platform that works with any LLM and supports advanced search, agents, RAG, and connectors.
Generative AIPermissive LicenseArtificial Intelligence+5
Open Core
Local Deep Research
9.2k
An AI-powered research assistant for deep, agentic research with citations, designed to run locally or via a self-hosted setup.
Artificial IntelligenceAI RAG SystemsAI Agents+6
3 Containers
Hister
6.0k
Hister is a private search engine that indexes the full contents of web pages and local files for searching via web, terminal, and MCP clients.
Self Hosting SolutionsAI RAG SystemsModel Context Protocol+1
Single Container
Apache Solr
1.7k
Apache Solr is an open source multi-modal search platform for full-text, vector, and geospatial search.
Search EnginesPermissive LicenseDatabase Management+2
Khoj
37.6k
Khoj is a personal AI app for chat, search, and automation that can run locally or as a cloud service.
Artificial IntelligenceCopyleft LicenseGenerative AI+5
5 ContainersOpen Core
OpenExecutive
5.6k
An AI executive assistant platform that provides a unified virtual leadership voice backed by specialist agents for strategy, finance, HR, legal, operations, marketing, product, and board communications.
Artificial IntelligenceAI AgentsAI RAG Systems+4
2 ContainersCloud Required
GPT4All
77.4k
GPT4All runs large language models privately on everyday desktops and laptops, and provides a Python client around llama.cpp implementations.
Artificial IntelligenceLocal LLMsAI Interfaces+2
Amgix
9
Amgix is an open-source hybrid search system that provides ingestion, embedding, keyword/semantic retrieval, and ranking behind a REST API.
Search EnginesAI RAG SystemsAI Tooling+2
Single ContainerFully FOSS
Dify.ai
158.1k
An open-source platform for building, testing, and operating LLM-powered applications with workflows, RAG, agents, and observability.
Low Code DevelopmentFOSS with IssuesOpen-Washing Risk+6
36 ContainersOpen CoreFOSS with Issues
ElasticSearch
78.2k
Elasticsearch is a distributed search and analytics engine, scalable data store, and vector database for production-scale workloads.
Search EnginesDatabase ManagementAnalytics Tools+1
Open Core
MindsDB
39.8k
Minds Platform is a general-purpose AI workspace for knowledge workers to automate multi-step tasks and build internal AI tools.
Database ManagementArtificial IntelligenceAI RAG Systems+4
Open Core
Cody
3.8k
Type less, code more: Cody is an AI code assistant that uses advanced search and codebase context to help you write and fix code.
Artificial IntelligenceAI Coding AssistantPermissive License+2
BionicGPT
2.4k
Bionic is an on-premise, ChatGPT-like generative AI platform for running locally or at data-center scale with strict data confidentiality.
Artificial IntelligenceAI InterfacesAI RAG Systems+3
Open Core
Flowise
55.5k
Flowise is a visual tool for building AI agents.
Self Hosting SolutionsAI AgentsAI RAG Systems+3
Single Container