Self-hostable software: AI & ML Practitioners (23)
Best for your setup
Homelab Expert
Runs a stack already and wants it to plug in.
Langfuse35.5k
Langfuse is an open source LLM engineering platform for teams to develop, monitor, evaluate, and debug AI applications.
- REST or GraphQL API
- Multi-user
See all87/100 fitHow well this app matches homelab experts, 0 to 100
Homelab Hacker
Wants control: APIs, scripts and many ways to run it.
Langflow155.6k
Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.
- Scriptable API
- Many ways to install
See all89/100 fitHow well this app matches homelab hackers, 0 to 100
23 projects
Langflow
155.6k
Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.
Low Code DevelopmentAutomation ToolsModel Context Protocol+2
11 Containers
vLLM
93.4k
A fast, easy-to-use library for LLM inference and serving.
Inference ServingLocal LLMsAI Tooling
2 Containers
Langfuse
35.5k
Langfuse is an open source LLM engineering platform for teams to develop, monitor, evaluate, and debug AI applications.
IDE ToolsArtificial IntelligencePermissive License+5
6 ContainersFOSS with Issues
text-generation-webui
47.7k
A desktop app for running local LLMs with chat, vision, tool-calling, training, image generation, and an API.
Artificial IntelligenceSelf Hosting SolutionsAI Interfaces+2
Single Container
KoboldCpp
12.0k
KoboldCpp is a self-contained AI text-generation runner for GGML and GGUF models, with bundled UI, multiple inference modes, and broad support for image, audio, video, and vision tasks.
Inference ServingLocal LLMsAI Interfaces+2
Single Container
AutoGPT
187.7k
AutoGPT is a platform for creating, deploying, and managing continuous AI agents that automate complex workflows.
Artificial IntelligenceAutomation ToolsPermissive License+2
13 ContainersOpen Core
LiteLLM
60.3k
LiteLLM is an open source AI gateway and Python SDK for calling 100+ LLM providers through a unified OpenAI-compatible interface.
API ManagementProxy ServersArtificial Intelligence+2
3 ContainersOpen Core
llamafile
26.2k
llamafile lets users distribute and run LLMs as a single-file executable with no installation. It also includes whisperfile for local speech-to-text transcription and translation.
Artificial IntelligenceLocal LLMsAI Tooling+2
Netron
33.6k
Netron is a viewer for neural network, deep learning, and machine learning models.
Analytics ToolsPermissive LicenseArtificial Intelligence+2
LLM
12.6k
A CLI tool and Python library for interacting with large language models from remote APIs or locally installed models.
Artificial IntelligenceLocal LLMsAI Tooling+1
Local Deep Research
9.2k
An AI-powered research assistant for deep, agentic research with citations, designed to run locally or via a self-hosted setup.
Artificial IntelligenceAI RAG SystemsAI Agents+6
3 Containers
agentos
4.7k
agentOS is a library for running AI agents inside an application process with VM-like isolation, persistence, permissions, and orchestration.
AI AgentsArtificial IntelligenceAI Tooling
Single Container