LLMKube
★ 231Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.
Community Ratings
No ratings yetNew this week
Read recap →Weekly Recap — Sep 25, 2026 – Oct 2, 2026Oct 2, 2026
Details
- Last Updated
- Oct 7, 2026
- Created
- Nov 12, 2025
- Runtime / Stack
- GoDockerK8S
- Deployment
Deployment: no container deployment found
Tags
Track your self-hosted stack
Bookmark software to try, rate tools you've used, and keep your collection in one place.
Related Software
Lobe Chat
83.0k
LobeHub is a self-hostable AI agent platform for organizing, creating, and collaborating with multi-agent workflows.
Artificial IntelligenceAI InterfacesSelf Hosting Solutions+3
6 Containers
AnythingLLM
66.8k
An all-in-one AI application for chatting with documents, building AI agents, and running local or cloud LLM workflows.
Artificial IntelligenceAutomation ToolsSelf Hosting Solutions+7
Single Container
SillyTavern
34.2k
SillyTavern is a locally installed interface for interacting with text generation LLMs, image generation engines, and TTS voice models.
Artificial IntelligenceAI InterfacesCopyleft License+3
Single Container
Ollama
182.5k
Ollama is a tool for running open models locally and exposing them through a REST API for apps, agents, and integrations.
Artificial IntelligenceLocal LLMsGenerative Artificial Intelligence Genai+3
Langflow
155.6k
Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.
Low Code DevelopmentAutomation ToolsModel Context Protocol+2
11 Containers
vLLM
93.4k
A fast, easy-to-use library for LLM inference and serving.
Inference ServingLocal LLMsAI Tooling
2 Containers
Postiz
36.9k
Postiz is a social media management platform for scheduling, automating, and analyzing content.
Analytics ToolsAutomation ToolsSocial Media+3
9 Containers
Langfuse
35.5k
Langfuse is an open source LLM engineering platform for teams to develop, monitor, evaluate, and debug AI applications.
IDE ToolsArtificial IntelligencePermissive License+5
6 ContainersFOSS with Issues
LobeHub
83.0k
LobeHub is a self-hostable platform for organizing, building, and collaborating with AI agents as teammates.
Artificial IntelligenceGenerative Artificial Intelligence GenaiSelf Hosting Solutions+4
10 ContainersCloud Required
LocalAI
49.4k
LocalAI is an open-source AI engine that runs LLMs and other multimodal models locally on a wide range of hardware, with OpenAI-compatible APIs and on-demand backends.
Generative Artificial Intelligence GenaiPermissive LicenseArtificial Intelligence+4
Single Container
Zed
91.4k
Zed is a high-performance multiplayer code editor.
Artificial IntelligenceAI Coding AssistantIDE Tools+2
2 Containers
Codex
128.2k
Codex CLI is a local coding agent from OpenAI that runs on your computer.
Artificial IntelligenceAI Coding AssistantPermissive License+3