LiteLLM
★ 59.3kotherOpen Core — Some Features Paid3 Containers — 3 containers — light hosting footprintPackage · BinaryNeeds Postgres2 documented maintainers
About
LiteLLM is an open source AI gateway and Python SDK designed for teams that need a single interface to work with many LLM providers. It abstracts provider-specific SDKs and request formats so...
Community Ratings
No ratings yetNew this week
Read recap →Weekly Recap — Sep 11, 2026 – Sep 18, 2026Sep 18, 2026
Features
- Unified API for 100+ LLMs
- OpenAI-compatible requests
- Python SDK
- AI Gateway / proxy server
- Virtual keys
- Spend tracking
- Guardrails
- Load balancing
- Admin dashboard
- A2A agent support
Details
- Last Updated
- Sep 21, 2026
- Created
- Jul 27, 2023
- Install Methods
- package-managerbinary
- Requirements
- PythonLLM provider API keys
- Authentication
- local
- API
- REST
- Privacy & Independence
- Cloud: Optional
- User Model
- Multi-User
- Deployment
Deployment: Docker Compose ✓3 Containers — light hosting footprintRuns as 3 containers
Docker Compose
3 services · database: postgres · infra: postgres · 1 unclassified (prometheus)
no resource limits declared
needs persistent storage (3 volumes)
docker-compose.yml · @ e1717c5 · scanned Aug 7, 2026
services:
litellm:
build:
context: .
args:
target: runtime
image: docker.litellm.ai/berriai/litellm:main-stable
#########################################
## Uncomment these lines to start proxy with a config.yaml file ##
# volumes:
# - ./config.yaml:/app/config.yaml
# command:
# - "--config=/app/config.yaml"
##############################################
ports:
- "4000:4000" # Map the container port to the host, change the host port if necessary
environment:
DATABASE_URL: "postgresql://llmproxy:dbpassword9090@db:5432/litellm"
# Optional: route read-only queries (find_*, count, group_by, query_raw/_first)
# to a separate reader endpoint, e.g. an Aurora reader. Leave unset for
# ...
Tags
Track your self-hosted stack
Bookmark software to try, rate tools you've used, and keep your collection in one place.
Metadata extracted from README on Aug 7, 2026
Related Software
hermes-agent
247.5k
Hermes Agent is a self-improving AI agent with a built-in learning loop, terminal UI, and messaging gateway for chatting and automating work across platforms.
Artificial IntelligenceAI AgentsAI Coding Assistant+2
2 Containers
opencode
208.9k
An open source AI coding agent.
Artificial IntelligenceAI Coding AssistantPermissive License+3
n8n
205.5k
n8n is a fair-code platform for building and deploying AI agents and workflow automation with a visual canvas and custom code.
Automation ToolsPermissive LicenseLow Code Development+5
Single ContainerSource AvailableNot FOSS
AutoGPT
187.5k
AutoGPT is a platform for creating, deploying, and managing continuous AI agents that automate complex workflows.
Artificial IntelligenceAutomation ToolsPermissive License+2
13 ContainersOpen Core
Ollama
181.3k
Ollama is a tool for running open models locally and exposing them through a REST API for apps, agents, and integrations.
Artificial IntelligenceLocal LLMsGenerative Artificial Intelligence Genai+3
Dify.ai
156.6k
An open-source platform for building, testing, and operating LLM-powered applications with workflows, RAG, agents, and observability.
Low Code DevelopmentArtificial IntelligencePermissive License+6
36 ContainersOpen CoreFOSS with Issues
Langflow
155.1k
Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.
Low Code DevelopmentAutomation ToolsModel Context Protocol+2
11 Containers
Open-WebUI
152.7k
Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.
Artificial IntelligenceAI InterfacesLocal LLMs+7
2 ContainersOpen CoreFOSS with Issues
Claude Code
147.2k
Claude Code is an agentic coding tool that runs in the terminal and helps with coding tasks, code explanation, and git workflows using natural language commands.
Artificial IntelligenceAI Coding AssistantAI Harness+2
Cloud Required
ComfyUI
134.1k
ComfyUI is a modular node-based AI engine for creating images, video, 3D, audio, and other content with fine-grained control over models and parameters.
Artificial IntelligenceAI Media GenerationCopyleft License+2
Freemium
Codex
125.5k
Codex CLI is a local coding agent from OpenAI that runs on your computer.
Artificial IntelligenceAI Coding AssistantPermissive License+3
Pi
107.8k
Pi Agent Harness is a mono-repo for a self-extensible coding agent, including an interactive coding agent CLI, agent runtime, and a unified multi-provider LLM API.
AI HarnessAI AgentsAI Coding Assistant+1
