OpenLLM12.6k

bentoml/OpenLLM

Open sourceFreeAI ToolsSelf-hosted

What is OpenLLM?

Runs open source LLMs such as Llama and DeepSeek behind an OpenAI compatible API endpoint It has 12,583 stars on GitHub and ranks #213 in AI Tools. You can host it on your own server and keep your data.

GitHub description: Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Platforms

DockerCommand line

Top alternatives for OpenLLM

#171

LocalAI50.2k

Open source AI engine that runs LLM, vision and voice models locally.

AI ToolsSelf-hostedDockerCommand line

More AI Tools

OpenClaw394k

Personal AI assistant that carries out tasks for you across your computer and messaging apps.

Self-hostedDockerCommand line

Hermes Agent260.8k

Terminal AI agent that learns from use and improves its own skills over time.

Self-hostedCommand line

OpenCode224.8k

Open source AI coding agent that works in your terminal and desktop to write and edit code.

WindowsMacLinuxCommand line

AutoGPT187.9k

Platform for building and running autonomous AI agents with a visual interface.

Self-hostedWebDocker

Ollama186k

Download and run large language models locally with a single command.

Self-hostedWindowsMacLinuxDockerCommand line

Stable Diffusion WebUI165.3k

Generate AI images locally with Stable Diffusion through a browser-based interface.

Self-hostedWindowsLinuxWeb

Dify160.5k

Open source platform for building AI apps, agents and RAG pipelines.

Self-hostedWebDocker

Open WebUI157.9k

Self-hosted chat interface for Ollama and OpenAI compatible models.

Self-hostedWebDocker