selfhostedworld.com logoselfhostedworld.com

Try describing what you need:

Self-Hosted AI Tooling: 58 Open-Source Apps

All self-hosted AI tools

Comparisons in this tag:Ollama vs vLLM

58 projects
Dify.ai logo

Dify.ai

158.5k
An open-source platform for building, testing, and operating LLM-powered applications with workflows, RAG, agents, and observability.
Low Code DevelopmentArtificial IntelligencePermissive License+6
36 ContainersOpen CoreFOSS with Issues
Details
ZeroClaw logo

ZeroClaw

24
A small Rust-based AI assistant infrastructure and autonomous runtime with pluggable providers, channels, memory, tools, and security policies.
Claws & ClankersAI AgentsAI Tooling+2
Details
LLMKube logo

LLMKube

235
Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.
Artificial IntelligenceLocal LLMsInference Serving+2
Details
n8n logo

n8n

207.4k
n8n is a fair-code platform for building and deploying AI agents and workflow automation with a visual canvas and custom code.
Automation ToolsPermissive LicenseLow Code Development+5
Single ContainerSource AvailableNot FOSS
Details
Composio logo

Composio

30.6k
Composio SDK provides TypeScript and Python libraries for integrating AI agents with external apps and services.
API ManagementAI AgentsAutomation Tools+2
Cloud Required
Details
OpenManus logo

OpenManus

704
The project has moved to a new official repository, with an archived version available in a separate archive repository.
Artificial IntelligenceAI AgentsAutomation Tools+2
Details
Claude Code logo

Claude Code

150.9k
Claude Code is an agentic coding tool that runs in the terminal and helps with coding tasks, code explanation, and git workflows using natural language commands.
Artificial IntelligenceAI Coding AssistantAI Harness+2
Cloud Required
Details
Flowise logo

Flowise

55.5k
Flowise is a visual tool for building AI agents.
Self Hosting SolutionsAI AgentsAI RAG Systems+3
Single Container
Details
Text Generation Inference logo

Text Generation Inference

10.9k
A Rust, Python, and gRPC server for deploying and serving large language models with high-performance text generation.
Inference ServingArtificial IntelligenceLocal LLMs+1
2 Containers
Details
daytona logo

daytona

71.5k
Daytona is a secure infrastructure runtime for running AI-generated code and agent workflows in isolated sandboxes.
Artificial IntelligenceAI AgentsAI Tooling+2
Details