Try describing what you need:

AI & ML Practitioners: 21 Self-Hosted Apps

Best for your setup

  • Novice

    vLLM97.3k
    • Ships a Compose file
    • Live demo

    81/100 fitHow well this app matches homelab novices, 0 to 100

    See all
  • Expert

    prime-agent22.9k
    • SSO sign-in
    • REST or GraphQL API

    Default rank #12

    77/100 fitHow well this app matches homelab experts, 0 to 100

    See all
  • Hacker

    Langflow156.8k
    • Scriptable API
    • Many ways to install

    89/100 fitHow well this app matches homelab hackers, 0 to 100

    See all
21 projects
Langflow logo

Langflow

156.8k
Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.
Low Code DevelopmentAutomation ToolsModel Context Protocol+2
10 Containers
Details
vLLM logo

vLLM

97.3k
vLLM is a fast, easy-to-use library and server for LLM inference and serving.
Inference ServingLocal LLMsAI Tooling
2 Containers
Details
llamafile logo

llamafile

26.7k
llamafile lets users distribute and run LLMs as a single-file executable with no installation. It also includes whisperfile for local speech-to-text transcription and translation.
Artificial IntelligenceLocal LLMsAI Tooling+2
Details
KoboldCpp logo

KoboldCpp

12.4k
KoboldCpp is a self-contained AI text-generation runner for GGML and GGUF models, with bundled UI, multiple inference modes, and broad support for image, audio, video, and vision tasks.
Inference ServingLocal LLMsAI Interfaces+2
Single Container
Details
Letta logo

Letta

25.5k
Letta is a framework for building stateful agents with memory that can learn and improve over time.
AI AgentsAI ToolingGenerative AI
Details
AutoGPT logo

AutoGPT

188.1k
AutoGPT is a platform for creating, deploying, and managing continuous AI agents that automate complex workflows.
Artificial IntelligenceAutomation ToolsPermissive License+2
13 ContainersOpen Core
Details
LiteLLM logo

LiteLLM

63.7k
LiteLLM is an open source AI gateway and Python SDK for calling 100+ LLM providers through a unified OpenAI-compatible interface.
API ManagementProxy ServersArtificial Intelligence+2
3 ContainersOpen Core
Details
text-generation-webui logo

text-generation-webui

47.7k
A desktop app for running local LLMs with chat, vision, tool-calling, training, image generation, and an API.
Artificial IntelligenceSelf Hosting SolutionsAI Interfaces+2
Single Container
Details
LLM logo

LLM

12.8k
A CLI tool and Python library for interacting with large language models from remote APIs or locally installed models.
Artificial IntelligenceLocal LLMsAI Tooling+1
Details
Netron logo

Netron

33.7k
Netron is a viewer for neural network, deep learning, and machine learning models.
Analytics ToolsArtificial IntelligenceAI Tooling+2
Details
HuggingFace Chat UI logo

HuggingFace Chat UI

11.0k
A SvelteKit chat interface for OpenAI-compatible LLM APIs, powering HuggingChat.
Artificial IntelligenceAI InterfacesSelf Hosting Solutions+1
Details
prime-agent logo

prime-agent

22.9k
Prime Agent is an open-source coding and research agent for long-running work, built around a recursive language-model harness and persistent session state.
AI AgentsAI Coding AssistantAI Tooling+1
Details
Raven logo

Raven

6.3k
Raven is a host agent framework for orchestrating multiple specialized AI agents to carry out complex tasks and improve its own harness recursively.
Automation ToolsAI AgentsAI Harness+2
Single Container
Details
big-AGI logo

big-AGI

7.2k
Big-AGI is a multi-model AI workspace for experts, focused on chat, model comparison, and local-first self-hosting.
Artificial IntelligenceAI InterfacesAI Media Generation+2
Open Core
Details
earshot logo

earshot

5.5k
Earshot is a local CLI, Python API, and MCP server for analyzing audio and soundtracks, describing what they sound like, comparing them to references, and generating or improving sounds in code.
Artificial IntelligenceAI Media GenerationAI Tooling+2
Details
kev logo

kev

10.1k
Kev is a family of small decision models that users can run locally or fine-tune on their own labeled examples.
Artificial IntelligenceLocal LLMsInference Serving
Details
agentos logo

agentos

4.9k
agentOS provides tiny, fast Linux-compatible sandboxes powered by WebAssembly for running isolated agents and workloads.
AI AgentsArtificial IntelligenceAI Tooling
Single ContainerFreemium
Details
TinyClaw logo

TinyClaw

297
Tiny Claw is a Bun-native autonomous AI companion framework with a plugin architecture, adaptive memory, and a Discord-like web UI.
Artificial IntelligenceClaws & ClankersAI Agents+3
Details
OpenManus logo

OpenManus

746
The project has moved to a new official repository, with an archived version available in a separate archive repository.
Artificial IntelligenceAI AgentsAutomation Tools+2
Details
GenCAD logo

GenCAD

3.9k
GenCAD is a research project for image-conditioned CAD generation using transformer-based contrastive representations and diffusion priors.
Artificial IntelligenceAI Media GenerationManufacturing
2 Containers
Details
Text Generation Inference logo

Text Generation Inference

10.9k
A Rust, Python, and gRPC server for deploying and serving large language models with high-performance text generation.
Inference ServingArtificial IntelligenceLocal LLMs+1
2 Containers
Details