AI & ML Practitioners: 21 Self-Hosted Apps
Best for your setup
Homelab Expert
Runs a stack already and wants it to plug in.
prime-agent22.9k
Prime Agent is an open-source coding and research agent for long-running work, built around a recursive language-model harness and persistent session state.
- SSO sign-in
- REST or GraphQL API
See allDefault rank #12
77/100 fitHow well this app matches homelab experts, 0 to 100
Homelab Hacker
Wants control: APIs, scripts and many ways to run it.
Langflow156.8k
Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.
- Scriptable API
- Many ways to install
See all89/100 fitHow well this app matches homelab hackers, 0 to 100
21 projects
Langflow
156.8k
Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.
Low Code DevelopmentAutomation ToolsModel Context Protocol+2
10 Containers
vLLM
97.3k
vLLM is a fast, easy-to-use library and server for LLM inference and serving.
Inference ServingLocal LLMsAI Tooling
2 Containers
llamafile
26.7k
llamafile lets users distribute and run LLMs as a single-file executable with no installation. It also includes whisperfile for local speech-to-text transcription and translation.
Artificial IntelligenceLocal LLMsAI Tooling+2
KoboldCpp
12.4k
KoboldCpp is a self-contained AI text-generation runner for GGML and GGUF models, with bundled UI, multiple inference modes, and broad support for image, audio, video, and vision tasks.
Inference ServingLocal LLMsAI Interfaces+2
Single Container
Letta
25.5k
Letta is a framework for building stateful agents with memory that can learn and improve over time.
AI AgentsAI ToolingGenerative AI
AutoGPT
188.1k
AutoGPT is a platform for creating, deploying, and managing continuous AI agents that automate complex workflows.
Artificial IntelligenceAutomation ToolsPermissive License+2
13 ContainersOpen Core
LiteLLM
63.7k
LiteLLM is an open source AI gateway and Python SDK for calling 100+ LLM providers through a unified OpenAI-compatible interface.
API ManagementProxy ServersArtificial Intelligence+2
3 ContainersOpen Core
text-generation-webui
47.7k
A desktop app for running local LLMs with chat, vision, tool-calling, training, image generation, and an API.
Artificial IntelligenceSelf Hosting SolutionsAI Interfaces+2
Single Container
LLM
12.8k
A CLI tool and Python library for interacting with large language models from remote APIs or locally installed models.
Artificial IntelligenceLocal LLMsAI Tooling+1
Netron
33.7k
Netron is a viewer for neural network, deep learning, and machine learning models.
Analytics ToolsArtificial IntelligenceAI Tooling+2
HuggingFace Chat UI
11.0k
A SvelteKit chat interface for OpenAI-compatible LLM APIs, powering HuggingChat.
Artificial IntelligenceAI InterfacesSelf Hosting Solutions+1
prime-agent
22.9k
Prime Agent is an open-source coding and research agent for long-running work, built around a recursive language-model harness and persistent session state.
AI AgentsAI Coding AssistantAI Tooling+1
Raven
6.3k
Raven is a host agent framework for orchestrating multiple specialized AI agents to carry out complex tasks and improve its own harness recursively.
Automation ToolsAI AgentsAI Harness+2
Single Container
big-AGI
7.2k
Big-AGI is a multi-model AI workspace for experts, focused on chat, model comparison, and local-first self-hosting.
Artificial IntelligenceAI InterfacesAI Media Generation+2
Open Core
earshot
5.5k
Earshot is a local CLI, Python API, and MCP server for analyzing audio and soundtracks, describing what they sound like, comparing them to references, and generating or improving sounds in code.
Artificial IntelligenceAI Media GenerationAI Tooling+2
kev
10.1k
Kev is a family of small decision models that users can run locally or fine-tune on their own labeled examples.
Artificial IntelligenceLocal LLMsInference Serving
agentos
4.9k
agentOS provides tiny, fast Linux-compatible sandboxes powered by WebAssembly for running isolated agents and workloads.
AI AgentsArtificial IntelligenceAI Tooling
Single ContainerFreemium
TinyClaw
297
Tiny Claw is a Bun-native autonomous AI companion framework with a plugin architecture, adaptive memory, and a Discord-like web UI.
Artificial IntelligenceClaws & ClankersAI Agents+3
OpenManus
746
The project has moved to a new official repository, with an archived version available in a separate archive repository.
Artificial IntelligenceAI AgentsAutomation Tools+2
GenCAD
3.9k
GenCAD is a research project for image-conditioned CAD generation using transformer-based contrastive representations and diffusion priors.
Artificial IntelligenceAI Media GenerationManufacturing
2 Containers
Text Generation Inference
10.9k
A Rust, Python, and gRPC server for deploying and serving large language models with high-performance text generation.
Inference ServingArtificial IntelligenceLocal LLMs+1
2 Containers