Self-hostable software: Local LLMs

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Run Local LLMs on Any Device. Open-source and available for commercial use.

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

Distribute and run LLMs with a single file.

Access large language models from the command-line