OpenLLM

A platform to run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoints in the cloud, enabling seamless integration and deployment of language models.

OpenLLM is built in Python, distributed under the Apache License 2.0 license, 11.0k GitHub stars, latest release v0.6.20.

Stats refreshed

Language
Python
Latest Release
v0.6.20
License
Apache License 2.0

Our Newsletter

Get new AI tools right in your inbox

Get short emails with useful ai projects, releases, and repos worth watching.


Key Features

  • Run open-source LLMs
  • Compatible with OpenAI API
  • Cloud deployment support
  • Easy integration
  • Scalable solutions



Community

Stars
11.0k
Forks
693