LLMKube
★ 163Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.
Community Ratings
No ratings yetDetails
- Last Updated
- Jul 10, 2026
- Created
- Nov 12, 2025
- Runtime / Stack
- GoDockerK8S
- Deployment
Deployment: no container deployment found
Tags
Track your self-hosted stack
Bookmark software to try, rate tools you've used, and keep your collection in one place.
Related Software
hermes-agent
212.3k
Hermes Agent is a self-improving AI agent with a built-in learning loop, terminal UI, and messaging gateway for chatting and automating work across platforms.
Generative AIAI AgentsAI Coding Assistant+2
2 Containers
AutoGPT
185.4k
AutoGPT is a platform for creating, deploying, and managing continuous AI agents that automate complex workflows.
Artificial IntelligenceAutomation ToolsPermissive License+3
13 ContainersOpen Core
opencode
184.3k
An open source AI coding agent.
Artificial IntelligenceAI Coding AssistantPermissive License+4
Ollama
175.8k
Ollama is a tool for running open models locally and exposing them through a REST API for apps, agents, and integrations.
Generative AIArtificial IntelligenceLocal LLMs+3
Dify.ai
148.3k
An open-source platform for building, testing, and operating LLM-powered applications with workflows, RAG, agents, and observability.
Low Code DevelopmentPermissive LicenseGenerative AI+6
36 ContainersOpen CoreFOSS with Issues
Open-WebUI
144.9k
Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.
Generative AIArtificial IntelligenceAI Interfaces+7
2 ContainersOpen CoreFOSS with Issues
Claude Code
137.1k
Claude Code is an agentic coding tool that runs in the terminal and helps with coding tasks, code explanation, and git workflows using natural language commands.
Artificial IntelligenceAI Coding AssistantAI Harness+3
Cloud Required
ComfyUI
120.1k
ComfyUI is a modular node-based AI engine for creating images, video, 3D, audio, and other content with fine-grained control over models and parameters.
Artificial IntelligenceAI Media GenerationCopyleft License+3
Freemium
Codex
96.7k
Codex CLI is a local coding agent from OpenAI that runs on your computer.
Artificial IntelligenceAI Coding AssistantPermissive License+4
NextChatAI
88.4k
NextChat is a light, fast AI assistant web app and desktop client with support for multiple AI models and local browser storage.
Artificial IntelligenceAI InterfacesPermissive License+2
2 ContainersOpen Core
OpenHands
80.3k
An AI-driven development platform with a software agent SDK, CLI, local GUI, and hosted cloud offering.
Artificial IntelligenceAI Coding AssistantAI Agents+3
Single ContainerOpen Core
LobeHub
79.7k
LobeHub is a self-hostable platform for organizing, building, and collaborating with AI agents as a team.
Generative AISelf Hosting SolutionsAI Agents+3
6 Containers