llamafile
★ 26.6kAbout
llamafile is a Mozilla project for packaging and running large language models as a single executable file. It is aimed at developers and end users who want a simpler way to use open LLMs without...
Community Ratings
No ratings yetNew this week
Read recap →Weekly Recap — Nov 6, 2026 – Nov 13, 2026Nov 13, 2026
Features
- single-file LLM execution
- local inference
- cross-platform support
- no-install execution
- speech-to-text transcription
- audio translation
- example model downloads
- source installation
Details
- Last Updated
- Nov 14, 2026
- Created
- Sep 10, 2023
- Install Methods
- binarysource
- Requirements
- llama.cppCosmopolitan Libcwhisper.cpp
- Privacy & Independence
- No Cloud RequiredOffline Capable
- Deployment
Deployment: no container deployment found
Tags
Track your self-hosted stack
Bookmark software to try, rate tools you've used, and keep your collection in one place.
Metadata extracted from README on Mar 25, 2026
Alternatives to llamafile
GPT4All
77.3k
GPT4All runs large language models privately on everyday desktops and laptops, and provides a Python client around llama.cpp implementations.
Artificial IntelligenceLocal LLMsAI Interfaces+2
LocalAI
50.4k
LocalAI is an open-source AI engine for running LLMs and other model types locally on a wide range of hardware, with drop-in API compatibility for several popular AI APIs.
Generative AIPermissive LicenseArtificial Intelligence+4
Single Container
Ollama
187.0k
Ollama is a tool for running open models locally and exposing them through a REST API for apps, agents, and integrations.
Artificial IntelligenceLocal LLMsGenerative AI+3
KoboldCpp
12.3k
KoboldCpp is a self-contained AI text-generation runner for GGML and GGUF models, with bundled UI, multiple inference modes, and broad support for image, audio, video, and vision tasks.
Inference ServingLocal LLMsAI Interfaces+2
Single Container
text-generation-webui
47.7k
A desktop app for running local LLMs with chat, vision, tool-calling, training, image generation, and an API.
Artificial IntelligenceSelf Hosting SolutionsAI Interfaces+2
Single Container
Text Generation Inference
10.9k
A Rust, Python, and gRPC server for deploying and serving large language models with high-performance text generation.
Inference ServingArtificial IntelligenceLocal LLMs+1
2 Containers
vLLM
96.9k
vLLM is a fast, easy-to-use library and server for LLM inference and serving.
Inference ServingLocal LLMsAI Tooling
2 Containers
Jan
45.7k
Jan is an open-source desktop app for downloading and running local LLMs with privacy-focused, local control, while also offering optional connections to cloud model providers.
Artificial IntelligenceAI InterfacesPermissive License+1
Related Software
Open-WebUI
158.7k
Open WebUI is a self-hosted AI platform for chatting with LLMs, managing RAG, and building custom model workflows, designed to run entirely offline.
Artificial IntelligenceAI InterfacesLocal LLMs+7
2 ContainersOpen CoreFOSS with Issues
LLM Harbor
3.3k
Harbor is a CLI and companion app for spinning up and managing a local LLM stack with pre-wired services like Open WebUI, Ollama, llama.cpp, SearXNG, Speaches, and ComfyUI.
Artificial IntelligenceLocal LLMsAI Tooling+5
AnythingLLM
68.3k
An all-in-one AI application for chatting with documents, building AI agents, and running local or cloud LLM workflows.
Artificial IntelligenceAutomation ToolsGenerative AI+7
Single Container
LLM
12.8k
A CLI tool and Python library for interacting with large language models from remote APIs or locally installed models.
Artificial IntelligenceLocal LLMsAI Tooling+1
LibreChat
47.1k
LibreChat is a self-hosted AI chat platform that unifies major AI providers in a ChatGPT-like interface.
Artificial IntelligenceAI InterfacesPermissive License+4
5 Containers
LibreChat
47.1k
LibreChat is a self-hosted AI chat platform that unifies major AI providers in a ChatGPT-like interface.
Artificial IntelligenceAI InterfacesLocal LLMs+2
6 Containers
private-gpt
57.6k
PrivateGPT is an open-source API layer that turns local models into production AI applications.
Artificial IntelligenceAI RAG SystemsPermissive License+2
Dify.ai
161.2k
An open-source platform for building, testing, and operating LLM-powered applications with workflows, RAG, agents, and observability.
Low Code DevelopmentSelf Hosting SolutionsAutomation Tools+7
36 ContainersOpen CoreFOSS with Issues
Libre Translate
17.7k
A free and open source machine translation API that is entirely self-hosted.
Miscellaneous ToolsSoftware LocalizationArtificial Intelligence+3
Single Container
SillyTavern
35.6k
SillyTavern is a locally installed interface for interacting with text generation LLMs, image generation engines, and TTS voice models.
Artificial IntelligenceAI InterfacesCopyleft License+3
Single Container
Chatbox
42.3k
Chatbox is a desktop AI copilot and chat client for ChatGPT, Claude, and other LLM providers on Windows, macOS, and Linux.
Artificial IntelligenceAI InterfacesLocal LLMs
NextChatAI
89.0k
NextChat is a light, fast AI assistant web app and desktop client with support for multiple AI models and local browser storage.
Artificial IntelligenceAI InterfacesPermissive License+1
2 ContainersOpen Core