selfhostedworld.com logoselfhostedworld.com

Try describing what you need:

LiteLLM logo

LiteLLM

55.8k
otherOpen Core — Some Features Paid3 Containers — 3 containers — light hosting footprintPackage · BinaryNeeds Postgres2 documented maintainers

About

LiteLLM is an open source AI gateway and Python SDK designed for teams that need a single interface to work with many LLM providers. It abstracts provider-specific SDKs and request formats so...

Community Ratings

No ratings yet
LiteLLM AI Gateway

Features

  • Unified API for 100+ LLMs
  • OpenAI-compatible requests
  • Python SDK
  • AI Gateway / proxy server
  • Virtual keys
  • Spend tracking
  • Guardrails
  • Load balancing
  • Admin dashboard
  • A2A agent support

Details

Last Updated
Aug 7, 2026
Created
Jul 27, 2023
Install Methods
package-managerbinary
Requirements
PythonLLM provider API keys
Authentication
local
API
REST
Privacy & Independence
Cloud: Optional
User Model
Multi-User
Deployment

Deployment: Docker Compose ✓3 Containerslight hosting footprintRuns as 3 containers

Docker Compose

3 services · database: postgres · infra: postgres · 1 unclassified (prometheus)

no resource limits declared

needs persistent storage (3 volumes)

docker-compose.yml · @ e1717c5 · scanned Aug 7, 2026

services:
  litellm:
    build:
      context: .
      args:
        target: runtime
    image: docker.litellm.ai/berriai/litellm:main-stable
    #########################################
    ## Uncomment these lines to start proxy with a config.yaml file ##
    # volumes:
    #  - ./config.yaml:/app/config.yaml
    # command:
    #  - "--config=/app/config.yaml"
    ##############################################
    ports:
      - "4000:4000" # Map the container port to the host, change the host port if necessary
    environment:
      DATABASE_URL: "postgresql://llmproxy:dbpassword9090@db:5432/litellm"
      # Optional: route read-only queries (find_*, count, group_by, query_raw/_first)
      # to a separate reader endpoint, e.g. an Aurora reader. Leave unset for
# ...

Track your self-hosted stack

Bookmark software to try, rate tools you've used, and keep your collection in one place.

Metadata extracted from README on Aug 7, 2026

Related Software

hermes-agent logo

hermes-agent

226.6k
Hermes Agent is a self-improving AI agent with a built-in learning loop, terminal UI, and messaging gateway for chatting and automating work across platforms.
Artificial IntelligenceAI AgentsAI Coding Assistant+2
2 Containers
Details
n8n logo

n8n

199.6k
n8n is a fair-code platform for building and deploying AI agents and workflow automation with a visual canvas, custom code, and 1500+ integrations.
Automation ToolsPermissive LicenseLow Code Development+5
Single ContainerOpen CoreNot FOSS
Details
opencode logo

opencode

194.4k
An open source AI coding agent.
Artificial IntelligenceAI Coding AssistantPermissive License+3
Details
AutoGPT logo

AutoGPT

186.1k
AutoGPT is a platform for creating, deploying, and managing continuous AI agents that automate complex workflows.
Artificial IntelligenceAutomation ToolsPermissive License+2
13 ContainersOpen Core
Details
Ollama logo

Ollama

177.9k
Ollama is a tool for running open models locally and exposing them through a REST API for apps, agents, and integrations.
Artificial IntelligenceLocal LLMsPermissive License+2
Details
Langflow logo

Langflow

152.9k
Langflow is a platform for building and deploying AI-powered agents and workflows with a visual builder, API deployment, and MCP server support.
Low Code DevelopmentAutomation ToolsModel Context Protocol+2
11 Containers
Details
Dify.ai logo

Dify.ai

151.6k
An open-source platform for building, testing, and operating LLM-powered applications with workflows, RAG, agents, and observability.
Low Code DevelopmentArtificial IntelligencePermissive License+6
36 ContainersOpen CoreFOSS with Issues
Details
Open-WebUI logo

Open-WebUI

148.1k
Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.
Artificial IntelligenceAI InterfacesLocal LLMs+6
2 ContainersOpen CoreFOSS with Issues
Details
Claude Code logo

Claude Code

140.5k
Claude Code is an agentic coding tool that runs in the terminal and helps with coding tasks, code explanation, and git workflows using natural language commands.
Artificial IntelligenceAI Coding AssistantAI Harness+2
Cloud Required
Details
ComfyUI logo

ComfyUI

124.4k
ComfyUI is a modular node-based AI engine for creating images, video, 3D, audio, and other content with fine-grained control over models and parameters.
Artificial IntelligenceAI Media GenerationCopyleft License+2
Freemium
Details
Codex logo

Codex

104.5k
Codex CLI is a local coding agent from OpenAI that runs on your computer.
Artificial IntelligenceAI Coding AssistantPermissive License+3
Details
NextChatAI logo

NextChatAI

88.6k
NextChat is a light, fast AI assistant web app and desktop client with support for multiple AI models and local browser storage.
Artificial IntelligenceAI InterfacesPermissive License+1
2 ContainersOpen Core
Details