Self-Hosted AI Tooling: 58 Open-Source Apps
Comparisons in this tag:Ollama vs vLLM
Best for your setup
Homelab Novice
Wants it running tonight, with one command.
LLM Harbor3.2k
Harbor is a CLI and companion app for spinning up and managing a local LLM stack with pre-wired services like Open WebUI, llama.cpp, Ollama, vLLM, SearXNG, Speaches, and ComfyUI.
- Ships a Compose file
- Live demo
See allDefault rank #23
82/100 fitHow well this app matches homelab novices, 0 to 100
Homelab Expert
Runs a stack already and wants it to plug in.
Langfuse35.8k
Langfuse is an open source LLM engineering platform for teams to develop, monitor, evaluate, and debug AI applications.
- REST or GraphQL API
- Multi-user
See all87/100 fitHow well this app matches homelab experts, 0 to 100
Homelab Hacker
Wants control: APIs, scripts and many ways to run it.
Langflow155.7k
Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.
- Scriptable API
- Many ways to install
See all89/100 fitHow well this app matches homelab hackers, 0 to 100
58 projects
Ollama
183.2k
Ollama is a tool for running open models locally and exposing them through a REST API for apps, agents, and integrations.
Artificial IntelligenceLocal LLMsGenerative AI+3
Langflow
155.7k
Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.
Low Code DevelopmentAutomation ToolsModel Context Protocol+2
11 Containers
vLLM
93.8k
A fast, easy-to-use library for LLM inference and serving.
Inference ServingLocal LLMsAI Tooling
2 Containers
Langfuse
35.8k
Langfuse is an open source LLM engineering platform for teams to develop, monitor, evaluate, and debug AI applications.
IDE ToolsArtificial IntelligencePermissive License+5
6 ContainersFOSS with Issues
Codex
129.3k
Codex CLI is a local coding agent from OpenAI that runs on your computer.
Artificial IntelligenceAI Coding AssistantPermissive License+3
opencode
213.6k
An open source AI coding agent.
Artificial IntelligenceAI Coding AssistantPermissive License+3
Context7
63.1k
Context7 provides up-to-date, version-specific library documentation and code examples for LLM prompts via a CLI skill flow or MCP server.
Model Context ProtocolArtificial IntelligencePermissive License+2
presidio
11.3k
Presidio is a PII detection and anonymization SDK for text and images. It helps organizations identify and de-identify sensitive data in automated or semi-automated workflows.
AI ToolingFully FOSSAutomation Tools
4 ContainersFully FOSS
oh-my-pi
35.5k
A coding agent with the IDE wired in.
AI Coding AssistantAI AgentsModel Context Protocol+1
2 Containers
hermes-agent
253.8k
Hermes Agent is a self-improving AI agent with a built-in learning loop, terminal UI, and messaging gateway for chatting and automating work across platforms.
Artificial IntelligenceAI AgentsAI Coding Assistant+2
2 Containers
Pi
115.2k
Pi Agent Harness is a mono-repo for a self-extensible coding agent, including an interactive coding agent CLI, agent runtime, and a unified multi-provider LLM API.
AI HarnessAI AgentsAI Coding Assistant+1
llamafile
26.2k
llamafile lets users distribute and run LLMs as a single-file executable with no installation. It also includes whisperfile for local speech-to-text transcription and translation.
Artificial IntelligenceLocal LLMsAI Tooling+2
Opik
22.6k
Opik is an open-source platform for observability, evaluation, monitoring, and optimization of LLM applications and agentic systems.
API ManagementArtificial IntelligenceAI Tooling+6
orca
92.6k
Orca is a desktop AI orchestrator that runs multiple CLI coding agents side-by-side in isolated git worktrees.
AI AgentsAI Coding AssistantAI Tooling+1
AutoGPT
187.6k
AutoGPT is a platform for creating, deploying, and managing continuous AI agents that automate complex workflows.
Artificial IntelligenceAutomation ToolsPermissive License+2
13 ContainersOpen Core
LiteLLM
61.3k
LiteLLM is an open source AI gateway and Python SDK for calling 100+ LLM providers through a unified OpenAI-compatible interface.
API ManagementProxy ServersArtificial Intelligence+2
3 ContainersOpen Core
Manifest
7.6k
Manifest is an OpenClaw plugin that routes requests to the most cost-effective LLM and provides a dashboard for tracking usage and costs.
Low Code DevelopmentArtificial IntelligencePermissive License+4
Telemetry: Opt-Out
Sim Studio
29.8k
An open-source platform for building AI agents and orchestrating agentic workflows with integrations, LLMs, and vector databases.
Automation ToolsArtificial IntelligenceAI Tooling+4
OpenSandbox
15.9k
OpenSandbox is a general-purpose sandbox platform for AI applications, providing SDKs, a CLI, MCP integration, and Docker/Kubernetes runtimes for running sandboxed workloads.
AI ToolingAI AgentsModel Context Protocol+1
2 Containers
LanguageTool
15.1k
LanguageTool is open-source proofreading software that detects writing errors across many languages and offers server, command-line, GUI, and HTTP API usage.
Miscellaneous ToolsCopyleft LicenseOffice Suites+1
LLM
12.6k
A CLI tool and Python library for interacting with large language models from remote APIs or locally installed models.
Artificial IntelligenceLocal LLMsAI Tooling+1
openclaude
33.9k
OpenClaude is an open-source terminal-first coding agent CLI for cloud and local model providers.
AI Coding AssistantAI AgentsAI Tooling+1
LLM Harbor
3.2k
Harbor is a CLI and companion app for spinning up and managing a local LLM stack with pre-wired services like Open WebUI, llama.cpp, Ollama, vLLM, SearXNG, Speaches, and ComfyUI.
Artificial IntelligenceLocal LLMsAI Tooling+5
Kong
44.3k
Kong Gateway is a cloud-native API, LLM, and MCP gateway for proxying, routing, load balancing, authentication, and plugin-based traffic control.
API ManagementArtificial IntelligencePermissive License+3
2 ContainersOpen Core
Netron
33.6k
Netron is a viewer for neural network, deep learning, and machine learning models.
Analytics ToolsPermissive LicenseArtificial Intelligence+2
Agenta
4.8k
Agenta is an open-source LLMOps platform for building production-grade LLM applications with prompt management, evaluation, and observability.
Artificial IntelligenceGenerative AIPermissive License+4
agentos
4.8k
agentOS is a library for running AI agents inside an application process with VM-like isolation, persistence, permissions, and orchestration.
AI AgentsArtificial IntelligenceAI Tooling
Single Container
ComfyUI
137.6k
ComfyUI is a modular node-based AI engine for creating images, video, 3D, audio, and other content with fine-grained control over models and parameters.
Artificial IntelligenceAI Media GenerationCopyleft License+2
Freemium
mastra
28.8k
Mastra is a TypeScript framework for building AI-powered applications, agents, workflows, and MCP servers.
Artificial IntelligenceAI AgentsAI Tooling+4
2 ContainersOpen CoreNot FOSS
prime-agent
22.0k
Prime Agent is an open-source coding and research agent for long-running work, built around a persistent Python REPL and a continual harness for durable state.
AI AgentsAI Coding AssistantAI Tooling+1
twinny
3.7k
Twinny is a free AI extension for Visual Studio Code that provides AI-assisted coding features.
Artificial IntelligenceAI Coding AssistantPermissive License+2
Judge0 CE
4.5k
Judge0 is an open-source online code execution system for running, compiling, and evaluating code in a sandboxed environment.
IDE ToolsCopyleft LicenseSelf Hosting Solutions+2
4 Containers
NullClaw
8.1k
NullClaw is a tiny Zig-based autonomous AI assistant infrastructure and CLI for configuring providers, channels, and gateway runtimes.
Claws & ClankersAI AgentsAI Tooling+1
flue
8.5k
Flue is a TypeScript framework for building autonomous agents with a programmable harness, tools, skills, sandboxes, and deployment options.
AI AgentsAutomation ToolsAI Tooling+1
onecli
3.6k
OneCLI is an open-source gateway that sits between AI agents and external services to inject and manage API credentials securely.
AI AgentsSecret ManagementModel Context Protocol+1
2 Containers
Raven
5.4k
Raven is a host agent framework for orchestrating multiple specialized AI agents to carry out complex tasks and improve its own harness recursively.
Automation ToolsAI AgentsAI Harness+2
Single Container
Backlog.md
7.0k
Markdown-native task manager and Kanban visualizer for any Git repository.
Artificial IntelligenceAI ToolingPermissive License+3
open-terminal
3.3k
Open Terminal is a self-hosted terminal service for AI agents and automation tools that provides command execution, file management, and code running through a REST API.
Self Hosting SolutionsAutomation ToolsAI Agents+2
Algernon
3.0k
A self-contained web server and application server with built-in support for Lua, templates, Markdown, JSX, databases, and HTTP/2/QUIC.
Web ServersPermissive LicenseSelf Hosting Solutions+2
Dagu
4.4k
Dagu is a lightweight workflow orchestrator with a web UI that runs DAG-based automation from declarative YAML.
Automation ToolsTask RunnersScheduling and Bookings+2
Single ContainerOpen Core
ollaya
1.3k
Ollaya runs open decision models locally and provides Ollama-like CLI, daemon, and API access for model serving.
Artificial IntelligenceLocal LLMsInference Serving+2
runtm
300
Runtm is an open-source platform for spinning up isolated sandboxes where coding agents can build, test, and deploy software.
Self Hosting SolutionsAI AgentsAI Tooling+1
4 Containers
GoModel
1.2k
GoModel is an AI gateway for routing, caching, tracking, and controlling access to LLM requests through an OpenAI- and Anthropic-compatible API.
Artificial IntelligenceSelf Hosting SolutionsProxy Servers+5
6 ContainersOpen Core
Jina
21.9k
A framework for building and deploying AI services with gRPC, HTTP, and WebSocket communication.
Search EnginesPermissive LicenseArtificial Intelligence+1
dirac
1.5k
Dirac is an open-source AI coding agent that performs precise, token-efficient code edits and refactorings using hash-anchored changes and AST-aware manipulation.
AI Coding AssistantAI AgentsAI Tooling+1
Cloud Required
TinyClaw
295
Tiny Claw is a Bun-native autonomous AI companion framework with a plugin architecture, adaptive memory, and a Discord-like web UI.
Artificial IntelligenceClaws & ClankersAI Agents+3
Amgix
9
Amgix is an open-source hybrid search system that provides ingestion, embedding, keyword/semantic retrieval, and ranking behind a REST API.
Search EnginesAI RAG SystemsSelf Hosting Solutions+2
Single ContainerFully FOSS
masume
105
masume is a keyboard-first terminal database client with AI chat and an MCP server for working with multiple database engines.
Database ManagementAI ToolingModel Context Protocol
10 Containers