Llama.cpp
Efficient LLM inference in C/C++ for high-performance computing applications.
There are 1 open-source alternatives to ONNX in this directory. The most popular is Llama.cpp with 103.2k GitHub stars. All are open source, free to use, and many can be self-hosted.
The top three are Llama.cpp(103.2k stars). All are open source and free to use.
Yes. Every tool listed here is open source and free to use in your own projects. Many can be self-hosted on your own infrastructure, which means no subscription fees and full control over your data.
Many of the alternatives listed are self-hostable. Each tool's page lists hosting details, system requirements, and licensing terms.
Get notified about new tools and updates to existing ones.